00000001:02000400:2.0F:1787114714.629007:0:2958:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg210-server.virtnet: executing set_hostid 00000001:02000400:2.0:1787114734.292248:0:3183:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg210-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1787114736.622711:0:3246:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 395 MB/s 00000001:01000000:2.0:1787114736.873300:0:3246:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 370 MB/s 00000001:01000000:3.0:1787114737.128447:0:3246:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2760 MB/s 00000020:02000000:2.0:1787114738.154139:0:3275:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.56_3_g13af17f 00000400:02000000:0.0F:1787114739.394463:0:3290:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.110@tcp [8/256/0/180] 00008000:02000000:3.0:1787114743.397353:0:3440:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0F:1787114793.841675:0:5243:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg210-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787114801.275521:0:5766:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787114801.275528:0:5766:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787114801.275671:0:5766:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000004ec672b0 00000080:02000400:1.0:1787114801.275682:0:5766:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1787114801.281900:0:5766:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1787114801.281914:0:5766:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787114801.281955:0:5766:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000009d90ae39) 00000020:00000080:1.0:1787114801.281977:0:5766:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787114801.296941:0:5766:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787114801.297314:0:5766:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787114801.315505:0:5766:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787114801.315530:0:5766:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787114801.315541:0:5766:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787114801.315569:0:5766:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787114801.315582:0:5766:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787114801.315848:0:5766:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787114801.315854:0:5766:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787114801.315863:0:5766:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x194cd781e88c7fed 00000020:01000004:3.0:1787114801.315870:0:5766:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787114801.315887:0:5766:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787114801.315893:0:5766:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004ec672b0 from MGS 00000020:01000004:3.0:1787114801.315897:0:5766:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787114801.315914:0:5766:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000a602651d) 00000020:00000080:3.0:1787114801.315929:0:5766:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787114801.315986:0:5766:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004ec672b0 from MGS, refs=2 00080000:01000000:3.0:1787114801.315991:0:5766:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787114801.315995:0:5766:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x194cd781e88c7ffb 00000100:00100000:3.0:1787114801.316232:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787114801.316350:0:5766:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787114801.316356:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787114801.316922:0:5766:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787114801.316929:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787114801.317586:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787114801.317693:0:5766:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787114801.317698:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787114801.318341:0:5766:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787114801.318348:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787114801.318721:0:5766:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787114801.318733:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787114801.319897:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114801.319901:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114801.319903:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114801.320334:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114801.320336:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114801.320338:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787114801.320832:0:5766:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787114801.327997:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787114801.570630:0:5766:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 5307 MB/s 00000001:01000000:3.0:1787114801.820585:0:5766:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4463 MB/s 00000001:01000000:3.0:1787114802.070746:0:5766:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 487 MB/s 00000001:01000000:1.0:1787114802.320480:0:5766:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 767 MB/s 00080000:10000000:1.0:1787114802.324743:0:5766:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1787114802.336540:0:5766:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787114802.336558:0:5766:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787114802.336561:0:5766:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787114802.337302:0:5776:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787114802.337351:0:5766:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787114802.337384:0:5766:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787114802.337596:0:5766:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787114802.337620:0:5766:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787114802.338224:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787114802.338364:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787114802.338370:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787114802.339522:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787114802.339530:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787114802.339651:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787114802.339656:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787114802.342479:0:5766:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000100:00080000:3.0:1787114802.342633:0:5781:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:0.0:1787114802.342702:0:5766:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.110@tcp' 00000020:01000004:0.0:1787114802.342704:0:5766:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787114802.342758:0:5766:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.110@tcp (typ=mgc) 00000020:00000080:0.0:1787114802.342777:0:5766:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.110@tcp (000000005bdaae89) 00000020:00000080:0.0:1787114802.342795:0:5766:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787114802.342930:0:5766:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000fa967a3e@MGC192.168.202.110@tcp: add connection 192.168.202.110@tcp at head 00010000:00010000:0.0:1787114802.345444:0:5766:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.110@tcp-0 is initialized 00000040:01000000:0.0:1787114802.345455:0:5766:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.110@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787114802.352625:0:5782:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787114802.352706:0:5766:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.110@tcp (uuid 6bfcc0b7-8035-40e1-91c8-e687d170788c) 00000020:00000080:3.0:1787114802.352730:0:5766:0:(genops.c:1406:class_connect()) connect: client 6bfcc0b7-8035-40e1-91c8-e687d170788c, cookie 0x194cd781e88c8009 00000100:00080000:3.0:1787114802.352741:0:5766:0:(import.c:510:import_select_connection()) MGC192.168.202.110@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787114802.352745:0:5766:0:(import.c:624:import_select_connection()) MGC192.168.202.110@tcp: import 00000000fa967a3e using connection 192.168.202.110@tcp/0@lo 00000100:00100000:3.0:1787114802.352785:0:5766:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e2909d76 x1873925624561792/t0(0) o250->MGC192.168.202.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787114802.352802:0:5766:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6bfcc0b7-8035-40e1-91c8-e687d170788c->MGS 00000020:01000004:3.0:1787114802.352822:0:5766:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787114802.352827:0:5766:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787114802.352842:0:5766:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000051afe1c4) 00000020:00000080:3.0:1787114802.352856:0:5766:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787114802.353098:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e2909d76 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6bfcc0b7-8035-40e1-91c8-e687d170788c:3305:1873925624561792:0@lo:250: 00000100:00100000:0.0:1787114802.353207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114802.353259:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624561792 00000100:00100000:2.0:1787114802.353266:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624561792 00000100:00100000:2.0:1787114802.353348:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787114802.353354:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0ce4e14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1873925624561792:12345-0@lo:250: 00010000:00080000:2.0:1787114802.353377:0:5778:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 6bfcc0b7-8035-40e1-91c8-e687d170788c@0@lo t0 exp 0000000000000000 cur 131 last 0 00000020:00000080:2.0:1787114802.353399:0:5778:0:(genops.c:1406:class_connect()) connect: client 6bfcc0b7-8035-40e1-91c8-e687d170788c, cookie 0x194cd781e88c8017 00000100:00080000:2.0:1787114802.353536:0:5778:0:(import.c:65:import_set_state_nolock()) 000000006adac1eb : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787114802.353591:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0ce4e14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+5:3305:x1873925624561792:12345-0@lo:250: Request processed in 236us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114802.353599:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787114802.353767:0:3305:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.110@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787114802.353775:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.110@tcp: connect to target with instance 0 00000100:00080000:0.0:1787114802.353782:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.110@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787114802.353786:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787114802.353789:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000fa967a3e MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787114802.353791:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787114802.353799:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787114802.353803:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e2909d76 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6bfcc0b7-8035-40e1-91c8-e687d170788c:3305:1873925624561792:0@lo:250: 00000100:00100000:3.0:1787114802.364339:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787114802.364611:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787114802.364618:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787114802.369486:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787114802.369501:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787114802.370748:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787114802.370757:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787114802.371660:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787114802.371831:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787114802.371836:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00010000:00010000:0.0:1787114802.373576:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787114802.378381:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787114802.378400:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787114802.458078:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787114802.458334:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787114802.458341:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787114802.463419:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787114802.463439:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787114802.465540:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787114802.465836:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787114802.465843:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787114802.466460:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787114802.466465:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787114802.468909:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787114802.469087:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787114802.469098:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787114802.471258:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787114802.471271:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787114802.471909:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787114802.472056:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787114802.472060:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787114802.473581:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787114802.473604:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787114802.537008:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787114802.537390:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787114802.537397:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787114802.549617:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787114802.549916:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787114802.622223:0:5766:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787114802.622241:0:5766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787114802.630192:0:5766:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787114802.630222:0:5766:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787114802.630229:0:5766:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.110@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787114802.630385:0:5766:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.110@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787114802.630434:0:5766:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.110@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1787114802.630438:0:5766:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787114802.630440:0:5766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787114802.630441:0:5766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787114802.630442:0:5766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787114802.630443:0:5766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787114802.630445:0:5766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787114802.630446:0:5766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787114802.630448:0:5766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787114802.630449:0:5766:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787114802.630451:0:5766:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787114802.630452:0:5766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787114802.630453:0:5766:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787114802.630455:0:5766:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1787114802.630457:0:5766:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787114802.630458:0:5766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787114802.630458:0:5766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787114802.630460:0:5766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787114802.630464:0:5766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787114802.630465:0:5766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787114802.630466:0:5766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787114802.630467:0:5766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787114802.630467:0:5766:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787114802.630616:0:5766:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787114802.630618:0:5766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787114802.630619:0:5766:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787114802.630654:0:5766:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787114802.630674:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000075df9c58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624561920:0@lo:253: 00000100:00100000:3.0:1787114802.630747:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114802.631988:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set 000000007f3624e3 going to sleep for 11 seconds 00000100:00100000:0.0:1787114802.632667:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624561920 00000100:00100000:0.0:1787114802.632678:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624561920 00000100:00100000:0.0:1787114802.632736:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787114802.632744:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8c3ce4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+5:5766:x1873925624561920:12345-0@lo:253: 20000000:01000000:0.0:1787114802.632793:0:5780:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787114802.632796:0:5780:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1787114802.634847:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787114802.634977:0:5780:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787114802.637321:0:5780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787114802.645518:0:5802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787114802.645884:0:5780:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787114802.645890:0:5780:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787114802.645897:0:5780:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787114802.645900:0:5780:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787114802.645918:0:5780:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787114802.646187:0:5780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787114802.646733:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787114802.646745:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787114802.646787:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787114802.646828:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787114802.646858:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787114802.646953:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787114802.646961:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787114802.646997:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787114802.647004:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787114802.647028:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787114802.647034:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787114802.647057:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787114802.647104:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787114802.647157:0:5780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787114802.647161:0:5780:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787114802.647172:0:5780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787114802.650363:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787114802.650396:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787114802.650462:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787114802.650501:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787114802.650580:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787114802.650597:0:5780:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787114802.650707:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787114802.650716:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787114802.650763:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787114802.650801:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787114802.650837:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787114802.650848:0:5780:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787114802.650944:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787114802.650953:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787114802.650986:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787114802.651025:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787114802.651234:0:5780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787114802.651285:0:5780:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787114802.651293:0:5780:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787114802.655885:0:5803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787114802.658826:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787114802.658857:0:5780:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.110@tcp for mdt 20000000:01000000:0.0:1787114802.658869:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.110@tcp (null) (null) (null) 00000040:00080000:0.0:1787114802.658908:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787114802.658917:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787114802.658950:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787114802.658970:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.110@tcp (null) (null) 00000040:00080000:0.0:1787114802.659017:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787114802.659028:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787114802.659081:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787114802.659177:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787114802.659241:0:5780:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787114802.659245:0:5780:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787114802.659249:0:5780:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787114802.659271:0:5780:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787114802.659273:0:5780:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787114802.667746:0:5780:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787114802.667755:0:5780:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787114802.668490:0:5804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1787114802.668869:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1787114802.668922:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1787114802.668971:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1787114802.668991:0:5780:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787114802.668993:0:5780:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787114802.669747:0:5805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1787114802.669967:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787114802.670009:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1787114802.670068:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1787114802.670082:0:5780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787114802.670085:0:5780:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1787114802.670090:0:5780:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787114802.670093:0:5780:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787114802.670097:0:5780:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787114802.670104:0:5780:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787114802.670978:0:5806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1787114802.671144:0:5780:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787114802.677224:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1787114802.677294:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1787114802.677371:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1787114802.677392:0:5780:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787114802.677416:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b9187711/0x194cd781e88c801e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114802.677433:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b9187711/0x194cd781e88c801e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114802.677462:0:5780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b9187711/0x194cd781e88c801e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114802.677481:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b9187711/0x194cd781e88c801e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114802.677488:0:5780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b9187711/0x194cd781e88c801e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114802.677494:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b9187711/0x194cd781e88c801e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114802.677663:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b9187711 already unused, calling callback (0000000005e33454) 00010000:00010000:2.0:1787114802.677667:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b9187711/0x194cd781e88c801e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114802.677675:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b9187711/0x194cd781e88c801e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114802.677688:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b9187711/0x194cd781e88c801e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114802.677696:0:5780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b9187711/0x194cd781e88c801e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114802.677702:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b9187711/0x194cd781e88c801e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787114802.677720:0:5780:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787114802.945892:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8c3ce4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+5:5766:x1873925624561920:12345-0@lo:253: Request processed in 313141us (315136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114802.945918:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787114802.946100:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000075df9c58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624561920:0@lo:253: 10000000:01000000:3.0:1787114802.946182:0:5766:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787114802.946186:0:5766:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787114802.946188:0:5766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787114802.946189:0:5766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787114802.946195:0:5766:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787114802.946197:0:5766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787114802.946198:0:5766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787114802.946200:0:5766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787114802.946201:0:5766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787114802.946202:0:5766:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787114802.946204:0:5766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787114802.946205:0:5766:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787114802.946228:0:5766:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004ec672b0 from lustre-MDT0000 10000000:01000000:3.0:1787114802.946251:0:5766:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787114802.946270:0:5766:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787114802.946275:0:5766:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8af05916cd40 10000000:01000000:3.0:1787114802.946279:0:5766:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787114802.946286:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8af05916cd40 from 1 10000000:01000000:3.0:1787114802.946293:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787114802.946334:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: 0000000016fac30c/0x194cd781e88c8025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114802.946344:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: 0000000016fac30c/0x194cd781e88c8025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114802.946358:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: 0000000016fac30c/0x194cd781e88c8025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114802.946375:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000075df9c58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624562048:0@lo:101: 00000100:00100000:3.0:1787114802.946416:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114802.946510:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set 000000001f2f4930 going to sleep for 11 seconds 00000100:00100000:2.0:1787114802.946585:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624562048 00000100:00100000:2.0:1787114802.946592:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624562048 00000100:00100000:2.0:1787114802.946683:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787114802.946701:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f07c247 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+5:5766:x1873925624562048:12345-0@lo:101: 00010000:00010000:2.0:1787114802.946713:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114802.946723:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b9187711/0x194cd781e88c802c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8025 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114802.946748:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b9187711/0x194cd781e88c802c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8025 expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114802.946761:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b9187711/0x194cd781e88c802c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8025 expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114802.946772:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b9187711, rc 0) 00000100:00100000:2.0:1787114802.946814:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f07c247 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+6:5766:x1873925624562048:12345-0@lo:101: Request processed in 124us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114802.946826:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787114802.946898:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000075df9c58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624562048:0@lo:101: 00010000:00010000:0.0:1787114802.946910:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: 0000000016fac30c/0x194cd781e88c8025 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c802c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114802.946918:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: 0000000016fac30c/0x194cd781e88c8025 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c802c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114802.946983:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000092adeab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624562176:0@lo:501: 00000100:00100000:0.0:1787114802.947013:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114802.947244:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set 000000005a85c349 going to sleep for 11 seconds 00000100:00100000:3.0:1787114802.947322:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624562176 00000100:00100000:3.0:1787114802.947326:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624562176 00000100:00100000:1.0:1787114802.947654:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787114802.947661:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005cf7393d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+6:5766:x1873925624562176:12345-0@lo:501: 00000100:00100000:1.0:1787114802.947880:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005cf7393d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+6:5766:x1873925624562176:12345-0@lo:501: Request processed in 220us (867us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787114802.947887:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787114802.947947:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000092adeab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624562176:0@lo:501: 10000000:01000000:0.0:1787114802.947971:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787114802.947989:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: 0000000016fac30c/0x194cd781e88c8025 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c802c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114802.947997:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: 0000000016fac30c/0x194cd781e88c8025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c802c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114802.948006:0:5766:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8af05032f000 10000000:01000000:0.0:1787114802.948010:0:5766:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787114802.948013:0:5766:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8af05032f000 10000000:01000000:0.0:1787114802.948015:0:5766:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787114802.948033:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8af05032f000 from 1 10000000:01000000:0.0:1787114802.948036:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787114802.948052:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: 0000000024d4b051/0x194cd781e88c8033 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114802.948059:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: 0000000024d4b051/0x194cd781e88c8033 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114802.948067:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: 0000000024d4b051/0x194cd781e88c8033 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114802.948079:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000092adeab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624562304:0@lo:101: 00000100:00100000:0.0:1787114802.948104:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114802.948309:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set 000000005a85c349 going to sleep for 11 seconds 00000100:00100000:2.0:1787114802.948368:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624562304 00000100:00100000:2.0:1787114802.948372:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624562304 00000100:00100000:2.0:1787114802.948391:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787114802.948396:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f17bde16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+6:5766:x1873925624562304:12345-0@lo:101: 00010000:00010000:2.0:1787114802.948403:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114802.948413:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000591e380/0x194cd781e88c803a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8033 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114802.948428:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000591e380/0x194cd781e88c803a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8033 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114802.948435:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000591e380/0x194cd781e88c803a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8033 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114802.948454:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000591e380, rc 0) 00000100:00100000:2.0:1787114802.948522:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f17bde16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+7:5766:x1873925624562304:12345-0@lo:101: Request processed in 126us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114802.948528:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787114802.948607:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000092adeab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624562304:0@lo:101: 00010000:00010000:0.0:1787114802.948617:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: 0000000024d4b051/0x194cd781e88c8033 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c803a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114802.948625:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: 0000000024d4b051/0x194cd781e88c8033 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c803a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114802.948635:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787114802.948647:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: 0000000024d4b051/0x194cd781e88c8033 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c803a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114802.948654:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: 0000000024d4b051/0x194cd781e88c8033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c803a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114802.948659:0:5766:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787114802.948663:0:5766:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787114802.948672:0:5766:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8af05032f000 10000000:01000000:0.0:1787114802.948674:0:5766:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787114802.948677:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787114802.948679:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787114802.948691:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: 00000000ac22dff4/0x194cd781e88c8041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114802.948697:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: 00000000ac22dff4/0x194cd781e88c8041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114802.948702:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: 00000000ac22dff4/0x194cd781e88c8041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114802.948712:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000092adeab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624562432:0@lo:101: 00000100:00100000:0.0:1787114802.948733:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114802.948743:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set 000000005a85c349 going to sleep for 11 seconds 00000100:00100000:2.0:1787114802.948795:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624562432 00000100:00100000:2.0:1787114802.948799:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624562432 00000100:00100000:2.0:1787114802.948823:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787114802.948828:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002cac62db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+7:5766:x1873925624562432:12345-0@lo:101: 00010000:00010000:2.0:1787114802.948834:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114802.948839:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000064ba63b5/0x194cd781e88c8048 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8041 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114802.948850:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000064ba63b5/0x194cd781e88c8048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8041 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114802.948867:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000064ba63b5/0x194cd781e88c8048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8041 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114802.948874:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000064ba63b5, rc 0) 00000100:00100000:2.0:1787114802.948938:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002cac62db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+8:5766:x1873925624562432:12345-0@lo:101: Request processed in 110us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114802.948944:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787114802.949101:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000092adeab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624562432:0@lo:101: 00010000:00010000:0.0:1787114802.949230:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: 00000000ac22dff4/0x194cd781e88c8041 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8048 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114802.949238:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: 00000000ac22dff4/0x194cd781e88c8041 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8048 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114802.949272:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000092adeab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624562560:0@lo:501: 00000100:00100000:0.0:1787114802.949293:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114802.949354:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set 000000005a85c349 going to sleep for 11 seconds 00000100:00100000:2.0:1787114802.949390:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624562560 00000100:00100000:2.0:1787114802.949394:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624562560 00000100:00100000:2.0:1787114802.949449:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787114802.949455:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000417d2a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+8:5766:x1873925624562560:12345-0@lo:501: 00000100:00100000:2.0:1787114802.949668:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000417d2a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+9:5766:x1873925624562560:12345-0@lo:501: Request processed in 214us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114802.949680:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787114802.949742:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000092adeab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624562560:0@lo:501: 00000100:00100000:0.0:1787114802.949763:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000092adeab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624562688:0@lo:503: 00000100:00100000:0.0:1787114802.949800:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114802.949818:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set 000000005a85c349 going to sleep for 11 seconds 00000100:00100000:3.0:1787114802.949878:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624562688 00000100:00100000:3.0:1787114802.949882:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624562688 00000100:00100000:3.0:1787114802.949944:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787114802.949950:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095c8fcc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+9:5766:x1873925624562688:12345-0@lo:503: 00000100:00100000:3.0:1787114802.950165:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095c8fcc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+9:5766:x1873925624562688:12345-0@lo:503: Request processed in 216us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114802.950172:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787114802.950242:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000092adeab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624562688:0@lo:503: 00000100:00100000:0.0:1787114802.950591:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000092adeab9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:5808:1873925624562816:0@lo:502: 00000100:00100000:0.0:1787114802.950621:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114802.950647:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 000000001b8ab642 going to sleep for 11 seconds 00000100:00100000:3.0:1787114802.950691:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624562816 00000100:00100000:3.0:1787114802.950696:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624562816 00000100:00100000:3.0:1787114802.950712:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787114802.950716:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cca524ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+9:5808:x1873925624562816:12345-0@lo:502: 00000100:00100000:3.0:1787114802.950841:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cca524ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+9:5808:x1873925624562816:12345-0@lo:502: Request processed in 124us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114802.950848:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787114802.950921:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000092adeab9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:5808:1873925624562816:0@lo:502: 00000020:01000000:0.0:1787114802.950939:0:5808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787114802.950950:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787114802.950952:0:5808:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787114802.950956:0:5808:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787114802.950958:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787114802.950969:0:5808:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000ae33f2a4) 00000020:00000080:0.0:1787114802.950985:0:5808:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787114802.950989:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787114802.951149:0:5808:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787114802.951155:0:5808:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x194cd781e88c8056 00000020:00000080:0.0:1787114802.951347:0:5808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787114802.951351:0:5808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787114802.951354:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787114802.951355:0:5808:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787114802.951358:0:5808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787114802.951361:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787114802.951362:0:5808:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787114802.951365:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787114802.951371:0:5808:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000420d6b54) 00000020:00000080:0.0:1787114802.951379:0:5808:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787114802.951382:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787114802.951384:0:5808:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787114802.951386:0:5808:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787114802.951396:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787114802.951438:0:5808:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004ec672b0 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787114802.951448:0:5808:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000072272de1) 00000020:00000080:0.0:1787114802.951455:0:5808:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787114802.951493:0:5808:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787114802.951496:0:5808:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x194cd781e88c806b 00000020:00000080:0.0:1787114802.951592:0:5808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787114802.951598:0:5808:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787114802.951602:0:5808:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x194cd781e88c8072 00080000:01000000:0.0:1787114802.951606:0:5808:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787114802.951609:0:5808:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x194cd781e88c8079 00080000:10000000:0.0:1787114802.951945:0:5808:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1787114802.952415:0:5808:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787114802.955612:0:5808:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1787114803.005556:0:5808:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1787114803.005915:0:5808:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1787114803.007463:0:5808:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1787114803.007653:0:5808:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787114803.037378:0:5808:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000004867e18f) 00000020:00000080:1.0:1787114803.037400:0:5808:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787114803.037459:0:5808:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787114803.037464:0:5808:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x194cd781e88c8087 00000020:00000080:1.0:1787114803.041830:0:5808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787114803.043591:0:5808:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787114803.077237:0:5808:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787114803.102870:0:5808:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787114803.128593:0:5808:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787114803.172703:0:5808:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787114803.198996:0:5808:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1787114803.224024:0:5808:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x194cd781e88c808e 00000020:00000080:3.0:1787114803.224500:0:5808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787114803.224511:0:5808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787114803.224516:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787114803.224519:0:5808:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787114803.224522:0:5808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787114803.224526:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787114803.224527:0:5808:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787114803.224530:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787114803.224532:0:5808:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787114803.224534:0:5808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787114803.224536:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787114803.224537:0:5808:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787114803.224539:0:5808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787114803.224543:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787114803.224544:0:5808:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787114803.224548:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787114803.224582:0:5808:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1787114803.224640:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000dc99e4b pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:5808:1873925624562944:0@lo:502: 00000100:00100000:3.0:1787114803.224718:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114803.224777:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 000000005235dac8 going to sleep for 11 seconds 00000100:00100000:0.0:1787114803.224843:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624562944 00000100:00100000:0.0:1787114803.224850:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624562944 00000100:00100000:0.0:1787114803.224915:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787114803.224924:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b56c3c48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+9:5808:x1873925624562944:12345-0@lo:502: 00000100:00100000:0.0:1787114803.225346:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b56c3c48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+9:5808:x1873925624562944:12345-0@lo:502: Request processed in 424us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114803.225361:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787114803.225533:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000dc99e4b pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:5808:1873925624562944:0@lo:502: 00000020:01000000:3.0:1787114803.225563:0:5808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787114803.225572:0:5808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787114803.225574:0:5808:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1787114803.225577:0:5808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787114803.225886:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787114803.225900:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787114803.225922:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: 00000000ac22dff4/0x194cd781e88c8041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8048 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114803.225934:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: 00000000ac22dff4/0x194cd781e88c8041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8048 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114803.225963:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8af05032f000 from 1 10000000:01000000:0.0:1787114803.225970:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787114803.225993:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: 000000009f0c61e9/0x194cd781e88c8095 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114803.226007:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: 000000009f0c61e9/0x194cd781e88c8095 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114803.226015:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: 000000009f0c61e9/0x194cd781e88c8095 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114803.226240:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000092adeab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624563072:0@lo:101: 00000100:00100000:0.0:1787114803.226345:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114803.226435:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set 000000008478173d going to sleep for 11 seconds 00000100:00100000:2.0:1787114803.226539:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624563072 00000100:00100000:2.0:1787114803.226544:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624563072 00000100:00100000:2.0:1787114803.226617:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787114803.226624:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058af8c94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+9:5766:x1873925624563072:12345-0@lo:101: 00010000:00010000:2.0:1787114803.226634:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114803.226646:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000f1b9c67/0x194cd781e88c809c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8095 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114803.226664:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000f1b9c67/0x194cd781e88c809c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8095 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114803.226674:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000f1b9c67/0x194cd781e88c809c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8095 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114803.226682:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000f1b9c67, rc 0) 00000100:00100000:2.0:1787114803.226720:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058af8c94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+10:5766:x1873925624563072:12345-0@lo:101: Request processed in 97us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114803.226726:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787114803.226776:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000092adeab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624563072:0@lo:101: 00010000:00010000:3.0:1787114803.226793:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: 000000009f0c61e9/0x194cd781e88c8095 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c809c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114803.226801:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: 000000009f0c61e9/0x194cd781e88c8095 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c809c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114803.227367:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000dc99e4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624563200:0@lo:256: 00000100:00100000:3.0:1787114803.227406:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114803.227675:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set 000000005235dac8 going to sleep for 11 seconds 00000100:00100000:0.0:1787114803.227775:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624563200 00000100:00100000:0.0:1787114803.227780:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624563200 00000100:00100000:0.0:1787114803.227803:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787114803.227814:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d55ba690 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+10:5766:x1873925624563200:12345-0@lo:256: 20000000:01000000:0.0:1787114803.227828:0:5780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787114803.227837:0:5780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787114803.227927:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d55ba690 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+10:5766:x1873925624563200:12345-0@lo:256: Request processed in 112us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114803.227933:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787114803.228003:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000dc99e4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624563200:0@lo:256: 10000000:01000000:3.0:1787114803.228612:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787114803.228631:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: 000000009f0c61e9/0x194cd781e88c8095 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c809c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114803.228639:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: 000000009f0c61e9/0x194cd781e88c8095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c809c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787114803.228646:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af05032f000 from 1 10000000:01000000:3.0:1787114803.228649:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787114803.228670:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: 00000000bfc0ff16/0x194cd781e88c80a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114803.228677:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: 00000000bfc0ff16/0x194cd781e88c80a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114803.228684:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: 00000000bfc0ff16/0x194cd781e88c80a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114803.228697:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000dc99e4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624563328:0@lo:101: 00000100:00100000:3.0:1787114803.228729:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114803.228743:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set 000000005235dac8 going to sleep for 11 seconds 00000100:00100000:3.0:1787114803.228758:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624563328 00000100:00100000:3.0:1787114803.228761:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624563328 00000100:00100000:3.0:1787114803.228779:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787114803.228784:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002dba2447 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+10:5766:x1873925624563328:12345-0@lo:101: 00010000:00010000:3.0:1787114803.228791:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787114803.228801:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008866a462/0x194cd781e88c80aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c80a3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114803.228815:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008866a462/0x194cd781e88c80aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c80a3 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114803.228823:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008866a462/0x194cd781e88c80aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c80a3 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114803.228830:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008866a462, rc 0) 00000100:00100000:3.0:1787114803.228854:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002dba2447 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:5766:x1873925624563328:12345-0@lo:101: Request processed in 70us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114803.228873:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787114803.228901:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000dc99e4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624563328:0@lo:101: 00010000:00010000:3.0:1787114803.228911:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: 00000000bfc0ff16/0x194cd781e88c80a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c80aa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114803.228918:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: 00000000bfc0ff16/0x194cd781e88c80a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c80aa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114803.228955:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000dc99e4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624563456:0@lo:501: 00000100:00100000:3.0:1787114803.228982:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114803.228993:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set 000000005235dac8 going to sleep for 11 seconds 00000100:00100000:3.0:1787114803.229004:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624563456 00000100:00100000:3.0:1787114803.229007:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624563456 00000100:00100000:0.0:1787114803.229337:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787114803.229345:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f677af3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:5766:x1873925624563456:12345-0@lo:501: 00000100:00100000:0.0:1787114803.229790:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f677af3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:5766:x1873925624563456:12345-0@lo:501: Request processed in 446us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114803.229805:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787114803.229957:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000dc99e4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624563456:0@lo:501: 00000100:00100000:1.0:1787114803.229998:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e9c8518c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624563584:0@lo:503: 00000100:00100000:1.0:1787114803.230042:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114803.230060:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set 000000000ff420d9 going to sleep for 11 seconds 00000100:00100000:0.0:1787114803.230194:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624563584 00000100:00100000:0.0:1787114803.230199:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624563584 00000100:00100000:0.0:1787114803.230228:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787114803.230234:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b36263f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:5766:x1873925624563584:12345-0@lo:503: 00000040:00080000:0.0:1787114803.230324:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787114803.230367:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b36263f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:5766:x1873925624563584:12345-0@lo:503: Request processed in 133us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114803.230373:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787114803.230467:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e9c8518c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624563584:0@lo:503: 00000040:00080000:1.0:1787114803.231868:0:5812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787114803.232015:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787114803.232084:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787114803.232101:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: 00000000bfc0ff16/0x194cd781e88c80a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c80aa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114803.232143:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: 00000000bfc0ff16/0x194cd781e88c80a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c80aa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787114803.232181:0:5766:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787114803.232183:0:5766:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8af05032f000 10000000:01000000:3.0:1787114803.232186:0:5766:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8af05032f000 10000000:01000000:3.0:1787114803.232190:0:5766:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787114803.232195:0:5766:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8af05032f000 from 1 10000000:01000000:3.0:1787114803.232197:0:5766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787114803.232223:0:5766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: 00000000f4d8e635/0x194cd781e88c80b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114803.232230:0:5766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: 00000000f4d8e635/0x194cd781e88c80b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114803.232239:0:5766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: 00000000f4d8e635/0x194cd781e88c80b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114803.232316:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ab14857f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624563712:0@lo:101: 00000100:00100000:3.0:1787114803.232360:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114803.232385:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set 00000000be68fc6a going to sleep for 11 seconds 00000100:00100000:3.0:1787114803.232411:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624563712 00000100:00100000:3.0:1787114803.232415:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624563712 00000100:00100000:3.0:1787114803.232493:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787114803.232500:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbe0d704 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:5766:x1873925624563712:12345-0@lo:101: 00010000:00010000:3.0:1787114803.232511:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787114803.232521:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000a230c0a/0x194cd781e88c80b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c80b1 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114803.232540:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a230c0a/0x194cd781e88c80b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c80b1 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114803.232550:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000a230c0a/0x194cd781e88c80b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c80b1 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114803.232559:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000a230c0a, rc 0) 00000100:00100000:3.0:1787114803.232587:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbe0d704 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:5766:x1873925624563712:12345-0@lo:101: Request processed in 88us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114803.232593:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787114803.232757:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ab14857f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624563712:0@lo:101: 00010000:00010000:3.0:1787114803.232768:0:5766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: 00000000f4d8e635/0x194cd781e88c80b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c80b8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114803.232776:0:5766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: 00000000f4d8e635/0x194cd781e88c80b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c80b8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114803.232814:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ab14857f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624563840:0@lo:501: 00000100:00100000:3.0:1787114803.232834:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114803.232853:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set 00000000be68fc6a going to sleep for 11 seconds 00000100:00100000:2.0:1787114803.232984:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624563840 00000100:00100000:2.0:1787114803.232989:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624563840 00000100:00100000:2.0:1787114803.233016:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787114803.233029:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df8c78f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:5766:x1873925624563840:12345-0@lo:501: 00000100:00100000:2.0:1787114803.233420:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df8c78f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:5766:x1873925624563840:12345-0@lo:501: Request processed in 392us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114803.233435:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787114803.233501:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ab14857f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624563840:0@lo:501: 00000100:00100000:0.0:1787114803.233526:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bce6061b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624563968:0@lo:503: 00000100:00100000:0.0:1787114803.233557:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114803.233580:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bceede04 going to sleep for 11 seconds 00000100:00100000:3.0:1787114803.233633:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624563968 00000100:00100000:3.0:1787114803.233641:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624563968 00000100:00100000:3.0:1787114803.233657:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787114803.233661:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7f3946a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:5766:x1873925624563968:12345-0@lo:503: 00000100:00100000:3.0:1787114803.233946:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7f3946a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:5766:x1873925624563968:12345-0@lo:503: Request processed in 284us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114803.233953:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787114803.234013:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bce6061b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624563968:0@lo:503: 00000100:00100000:3.0:1787114803.234473:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000370d49fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:5813:1873925624564096:0@lo:502: 00000100:00100000:3.0:1787114803.234506:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114803.234535:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c4a40ff9 going to sleep for 11 seconds 00000100:00100000:2.0:1787114803.234575:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624564096 00000100:00100000:2.0:1787114803.234579:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624564096 00000100:00100000:2.0:1787114803.234606:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787114803.234612:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3509187 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:5813:x1873925624564096:12345-0@lo:502: 00000100:00100000:2.0:1787114803.234809:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3509187 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:5813:x1873925624564096:12345-0@lo:502: Request processed in 197us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114803.234816:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787114803.234903:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000370d49fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:5813:1873925624564096:0@lo:502: 00000020:01000004:0.0:1787114803.234949:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787114803.234969:0:5813:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000083553e65) 00000020:00000080:0.0:1787114803.234987:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787114803.235544:0:5813:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004ec672b0 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787114803.235549:0:5813:0:(tgt_mount.c:187:server_put_mount()) put mount 000000004ec672b0 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787114803.235552:0:5813:0:(obd_mount.c:710:lustre_put_lsi()) put 000000004ec672b0 4 00010000:00080000:2.0:1787114803.235585:0:5813:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005ce27046@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.110@tcp at head 00010000:00010000:2.0:1787114803.238552:0:5813:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787114803.238639:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787114803.238670:0:5813:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787114803.238680:0:5813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x194cd781e88c80c6 00000100:00080000:2.0:1787114803.238689:0:5813:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787114803.238693:0:5813:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005ce27046 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:2.0:1787114803.238733:0:5813:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000009db26e7 x1873925624564224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787114803.238787:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000009db26e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873925624564224:0@lo:38: 00000100:00100000:0.0:1787114803.238844:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787114803.239080:0:5813:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787114803.239188:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624564224 00000100:00100000:1.0:1787114803.239200:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624564224 00000100:00100000:1.0:1787114803.239236:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787114803.239241:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bce6061b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1873925624564224:12345-0@lo:38: 00000100:00100000:2.0:1787114803.242226:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003f4b2dae pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:5813:1873925624564352:0@lo:502: 00000100:00100000:2.0:1787114803.242314:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114803.242353:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624564352 00000100:00100000:2.0:1787114803.242359:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624564352 00000100:00100000:2.0:1787114803.242399:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787114803.242406:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7113883 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:5813:x1873925624564352:12345-0@lo:502: 00000100:00100000:2.0:1787114803.242624:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7113883 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:5813:x1873925624564352:12345-0@lo:502: Request processed in 217us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114803.242631:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787114803.242675:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set 000000007b4b99f1 going to sleep for 11 seconds 00000100:00100000:2.0:1787114803.242693:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003f4b2dae pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:5813:1873925624564352:0@lo:502: 00000040:00080000:2.0:1787114803.242717:0:5813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:1.0:1787114803.244484:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bce6061b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1873925624564224:12345-0@lo:38: Request processed in 5235us (5633us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787114803.244496:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787114803.244613:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787114803.244621:0:3305:0:(import.c:65:import_set_state_nolock()) 000000005ce27046 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787114803.244626:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787114803.244629:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000009db26e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873925624564224:0@lo:38: 00000020:01000000:0.0:1787114803.244667:0:5766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787114803.244690:0:5766:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787114803.244713:0:5766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: 00000000f4d8e635/0x194cd781e88c80b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c80b8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114803.244724:0:5766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: 00000000f4d8e635/0x194cd781e88c80b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c80b8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787114803.244768:0:5766:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787114803.244770:0:5766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787114803.244771:0:5766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787114803.244772:0:5766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787114803.244773:0:5766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787114803.244774:0:5766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787114803.244776:0:5766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787114803.244777:0:5766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787114803.244778:0:5766:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787114803.244780:0:5766:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787114803.244781:0:5766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787114803.244782:0:5766:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787114803.244786:0:5766:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787114803.244788:0:5766:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787114803.244789:0:5766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787114803.244790:0:5766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787114803.244791:0:5766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787114803.244792:0:5766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787114803.244793:0:5766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787114803.244794:0:5766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787114803.244795:0:5766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787114803.244796:0:5766:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787114803.244797:0:5766:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787114803.244798:0:5766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787114803.244799:0:5766:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787114803.244819:0:5766:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787114803.244830:0:5766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a8e9cabf pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624564480:0@lo:253: 00000100:00100000:0.0:1787114803.244887:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114803.244920:0:5766:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bceede04 going to sleep for 11 seconds 00000100:00100000:2.0:1787114803.245160:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624564480 00000100:00100000:2.0:1787114803.245167:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624564480 00000100:00100000:2.0:1787114803.245207:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787114803.245214:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a4fddee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:5766:x1873925624564480:12345-0@lo:253: 20000000:01000000:2.0:1787114803.245234:0:5778:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787114803.245245:0:5778:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787114803.266967:0:5778:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787114803.266989:0:5778:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787114803.267189:0:5801:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787114803.267194:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787114803.267213:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000094f56878/0x194cd781e88c80cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114803.267231:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000f1b9c67/0x194cd781e88c809c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8095 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114803.267239:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000094f56878/0x194cd781e88c80cd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114803.267335:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000f1b9c67/0x194cd781e88c809c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c8095 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114803.267351:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000f1b9c67/0x194cd781e88c809c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c8095 expref: 12 pid: 5779 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114803.267365:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e9c8518c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5801:1873925624564608:0@lo:104: 00000100:00100000:1.0:1787114803.267425:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114803.267505:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fe44ba4d going to sleep for 11 seconds 00000100:00100000:0.0:1787114803.271356:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624564608 00000100:00100000:0.0:1787114803.271369:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624564608 00000100:00100000:0.0:1787114803.271473:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787114803.271481:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000893690eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:5801:x1873925624564608:12345-0@lo:104: 00010000:00010000:0.0:1787114803.271498:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: 000000009f0c61e9/0x194cd781e88c8095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c809c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114803.271581:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787114803.271586:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000893690eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:5801:x1873925624564608:12345-0@lo:104: Request processed in 107us (4162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114803.271593:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787114803.271793:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e9c8518c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5801:1873925624564608:0@lo:104: 00010000:00010000:1.0:1787114803.271814:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000094f56878/0x194cd781e88c80cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114803.272589:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a4fddee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:5766:x1873925624564480:12345-0@lo:253: Request processed in 27374us (27700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114803.272599:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1787114803.272661:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787114803.272666:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: 000000009f0c61e9/0x194cd781e88c8095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c809c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114803.272675:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009f0c61e9 already unused, calling callback (000000002174de54) 10000000:00010000:0.0:1787114803.272678:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: 000000009f0c61e9/0x194cd781e88c8095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c809c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114803.272687:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: 000000009f0c61e9/0x194cd781e88c8095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c809c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787114803.272692:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: 000000009f0c61e9/0x194cd781e88c8095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c809c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114803.272698:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787114803.272735:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: 000000009f0c61e9/0x194cd781e88c8095 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c809c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114803.272741:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787114803.272828:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000df9fcfed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624564736:0@lo:103: 00000100:00100000:3.0:1787114803.272872:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787114803.272955:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: 000000009f0c61e9/0x194cd781e88c8095 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c809c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114803.272963:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: 000000009f0c61e9/0x194cd781e88c8095 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c809c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114803.272979:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114803.272981:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114803.272982:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114803.273191:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624564736 00000100:00100000:2.0:1787114803.273197:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624564736 00010000:00010000:2.0:1787114803.273215:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000f1b9c67/0x194cd781e88c809c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8095 expref: 12 pid: 5779 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114803.273240:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787114803.273246:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000211100d8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:3307:x1873925624564736:12345-0@lo:103: 00010000:00010000:2.0:1787114803.273267:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787114803.273271:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000f1b9c67/0x194cd781e88c809c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8095 expref: 12 pid: 5779 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114803.273280:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000f1b9c67/0x194cd781e88c809c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c8095 expref: 12 pid: 5779 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114803.273293:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000f1b9c67/0x194cd781e88c809c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c8095 expref: 12 pid: 5779 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114803.273312:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000094f56878/0x194cd781e88c80cd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114803.273320:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000094f56878/0x194cd781e88c80cd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787114803.273333:0:5770:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006140159s 00010000:00010000:2.0:1787114803.273336:0:5770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000094f56878/0x194cd781e88c80cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114803.273342:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000094f56878/0x194cd781e88c80cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114803.273349:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000094f56878/0x194cd781e88c80cd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114803.273354:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000094f56878/0x194cd781e88c80cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114803.273358:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000094f56878 already unused, calling callback (0000000005e33454) 00010000:00010000:2.0:1787114803.273361:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000094f56878/0x194cd781e88c80cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114803.273367:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000094f56878/0x194cd781e88c80cd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114803.273380:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000094f56878/0x194cd781e88c80cd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114803.273388:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787114803.273460:0:5766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a8e9cabf pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:5766:1873925624564480:0@lo:253: 10000000:01000000:1.0:1787114803.273475:0:5766:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787114803.273478:0:5766:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787114803.273480:0:5766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787114803.273481:0:5766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787114803.273482:0:5766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787114803.273484:0:5766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787114803.273485:0:5766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787114803.273486:0:5766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787114803.273488:0:5766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787114803.273489:0:5766:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787114803.273490:0:5766:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787114803.273491:0:5766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787114803.273492:0:5766:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787114803.273504:0:5766:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787114803.276852:0:5801:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000094f56878/0x194cd781e88c80cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1787114803.277948:0:5766:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787114803.278340:0:5766:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787114803.278540:0:5766:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787114803.278687:0:5766:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787114803.278886:0:5766:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787114803.279035:0:5766:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000100:00100000:2.0:1787114803.279679:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000211100d8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:3307:x1873925624564736:12345-0@lo:103: Request processed in 6428us (6802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114803.279692:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787114803.279798:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000094f56878/0x194cd781e88c80cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114803.279804:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000094f56878/0x194cd781e88c80cd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114803.279933:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000df9fcfed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624564736:0@lo:103: 00080000:10000000:0.0:1787114803.280641:0:5766:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787114803.281338:0:5766:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787114803.281530:0:5766:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787114803.281675:0:5766:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787114803.281874:0:5766:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787114803.282103:0:5766:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1787114803.324521:0:5766:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000020:00080000:1.0:1787114803.342888:0:5818:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787114803.342896:0:5818:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787114803.342899:0:5766:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1787114803.343176:0:5819:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787114803.346234:0:5766:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787114803.346638:0:5766:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787114803.347162:0:5766:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787114803.347170:0:5766:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787114803.347344:0:5766:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787114803.348725:0:5766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787114803.349419:0:5766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787114803.349495:0:5766:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787114803.349711:0:5766:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787114803.349900:0:5766:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1787114803.351219:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787114803.351406:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787114803.351618:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787114803.351870:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787114803.352083:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787114803.352271:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787114803.352436:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787114803.352616:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787114803.352752:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787114803.352980:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787114803.353213:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787114803.353419:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787114803.353545:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787114803.353766:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787114803.354008:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787114803.354290:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787114803.354760:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787114803.355245:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787114803.355453:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787114803.355631:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787114803.355827:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787114803.356008:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787114803.356214:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787114803.356386:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787114803.356529:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787114803.356682:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787114803.356806:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787114803.356945:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787114803.357129:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787114803.357319:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787114803.357473:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787114803.357640:0:5766:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787114803.357827:0:5766:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1787114803.363711:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:0.0:1787114803.399235:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787114803.421228:0:5766:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787114803.421263:0:5766:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff96d2417b7988 00100000:10000000:1.0:1787114803.421271:0:5766:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787114803.421497:0:5766:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787114803.421511:0:5766:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.110@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787114803.421522:0:5766:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787114803.421546:0:5766:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1787114803.465325:0:5819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787114803.465409:0:5819:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787114803.465413:0:5819:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787114804.424209:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114805.446100:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787114806.470991:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114807.497006:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787114808.233780:0:6062:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg210-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787114808.517298:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787114808.711293:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787114808.711301:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787114808.711304:0:36:0:(import.c:65:import_set_state_nolock()) 000000005ce27046 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787114808.711316:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005ce27046 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1787114808.711336:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000020f5a841 x1873925624564992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787114808.711402:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787114808.711412:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004321bf87 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624564864:0@lo:400: 00000100:00100000:0.0:1787114808.711472:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114808.711520:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000020f5a841 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873925624564992:0@lo:38: 00000100:00100000:0.0:1787114808.711542:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114808.712011:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624564864 00000100:00100000:0.0:1787114808.712019:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624564864 00000100:00100000:0.0:1787114808.712074:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787114808.712082:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071252e22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:3309:x1873925624564864:12345-0@lo:400: 00000100:00100000:0.0:1787114808.712154:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071252e22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:3309:x1873925624564864:12345-0@lo:400: Request processed in 73us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114808.712161:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787114808.712203:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004321bf87 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624564864:0@lo:400: 00000100:00100000:1.0:1787114808.716840:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624564992 00000100:00100000:1.0:1787114808.716855:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624564992 00000100:00100000:1.0:1787114808.718169:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787114808.718178:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066789771 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1873925624564992:12345-0@lo:38: 00010000:00080000:1.0:1787114808.718210:0:5787:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 137 last 0 00000020:00000080:1.0:1787114808.718245:0:5787:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x194cd781e88c80d4 00000004:00100000:1.0:1787114808.718282:0:5787:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787114808.718384:0:5787:0:(import.c:65:import_set_state_nolock()) 000000004a07043a : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787114808.718474:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066789771 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873925624564992:12345-0@lo:38: Request processed in 295us (6930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114808.718481:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787114808.718531:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000020f5a841 x1873925624564992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787114818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787114808.718548:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787114808.718556:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787114808.718560:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787114808.718562:0:3305:0:(import.c:65:import_set_state_nolock()) 000000005ce27046 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787114808.718576:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000020f5a841 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873925624564992:0@lo:38: 00010000:00010000:0.0:1787114809.546804:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787114810.565911:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787114811.274226:0:5782:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787114811.274234:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8af05032f000 from 3 10000000:01000000:0.0:1787114811.274239:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787114811.274288:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: 00000000fe17cf0b/0x194cd781e88c80db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114811.274317:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: 00000000fe17cf0b/0x194cd781e88c80db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114811.274328:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: 00000000fe17cf0b/0x194cd781e88c80db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114811.274363:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004321bf87 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624565120:0@lo:101: 00000100:00100000:0.0:1787114811.274453:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114811.274524:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set 000000001949d9de going to sleep for 11 seconds 00000100:00100000:3.0:1787114811.274966:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624565120 00000100:00100000:3.0:1787114811.274975:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624565120 00000100:00100000:3.0:1787114811.275031:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787114811.275040:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038c9bd74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:5782:x1873925624565120:12345-0@lo:101: 00010000:00010000:3.0:1787114811.275052:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787114811.275064:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000030a02baf/0x194cd781e88c80e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c80db expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114811.275085:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000030a02baf/0x194cd781e88c80e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c80db expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114811.275095:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000030a02baf/0x194cd781e88c80e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c80db expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114811.275104:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000030a02baf, rc 0) 00000100:00100000:3.0:1787114811.275164:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038c9bd74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:5782:x1873925624565120:12345-0@lo:101: Request processed in 126us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114811.275171:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787114811.277496:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004321bf87 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624565120:0@lo:101: 00010000:00010000:2.0:1787114811.277521:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: 00000000fe17cf0b/0x194cd781e88c80db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c80e2 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114811.277531:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: 00000000fe17cf0b/0x194cd781e88c80db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c80e2 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114811.277615:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003f4b2dae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624565248:0@lo:256: 00000100:00100000:2.0:1787114811.277681:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114811.277732:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set 000000005594d0eb going to sleep for 11 seconds 00000100:00100000:0.0:1787114811.277874:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624565248 00000100:00100000:0.0:1787114811.277881:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624565248 00000100:00100000:0.0:1787114811.277934:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787114811.277942:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040691a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:5782:x1873925624565248:12345-0@lo:256: 20000000:01000000:0.0:1787114811.277962:0:5779:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787114811.277978:0:5779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787114811.277981:0:5779:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787114811.278093:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040691a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:5782:x1873925624565248:12345-0@lo:256: Request processed in 152us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114811.278100:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787114811.278152:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003f4b2dae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624565248:0@lo:256: 10000000:01000000:1.0:1787114811.278195:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787114811.278200:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: 00000000fe17cf0b/0x194cd781e88c80db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c80e2 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114811.278213:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: 00000000fe17cf0b/0x194cd781e88c80db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c80e2 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114811.590141:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787114812.613242:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787114813.582856:0:6264:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc81373290 20000000:00000080:1.0:1787114813.582875:0:6264:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8af07b2ee000 uarg=0000000000000000 20000000:01000000:1.0:1787114813.582907:0:6264:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787114813.582913:0:6264:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787114813.582918:0:6264:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787114813.583693:0:6264:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787114813.583709:0:6264:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787114813.587562:0:6264:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787114813.588008:0:6264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787114813.588068:0:6264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787114813.588357:0:6264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787114813.588376:0:6264:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787114813.588416:0:6264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c5f2c439/0x194cd781e88c80e9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114813.588433:0:6264:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008866a462/0x194cd781e88c80aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c80a3 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114813.588440:0:6264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c5f2c439/0x194cd781e88c80e9 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114813.588476:0:6264:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008866a462/0x194cd781e88c80aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c80a3 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114813.588493:0:6264:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008866a462/0x194cd781e88c80aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c80a3 expref: 11 pid: 5780 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114813.588521:0:6264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e9c8518c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6264:1873925624565376:0@lo:104: 00000100:00100000:1.0:1787114813.588582:0:6264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114813.588684:0:6264:0:(client.c:2702:ptlrpc_set_wait()) set 00000000024b57a3 going to sleep for 11 seconds 00000100:00100000:0.0:1787114813.589344:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624565376 00000100:00100000:0.0:1787114813.589352:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624565376 00000100:00100000:0.0:1787114813.589434:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787114813.589443:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d641a744 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:6264:x1873925624565376:12345-0@lo:104: 00010000:00010000:0.0:1787114813.589456:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: 00000000bfc0ff16/0x194cd781e88c80a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c80aa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114813.589527:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787114813.589540:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d641a744 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:6264:x1873925624565376:12345-0@lo:104: Request processed in 98us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114813.589547:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787114813.589808:0:6264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e9c8518c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6264:1873925624565376:0@lo:104: 00010000:00010000:2.0:1787114813.589827:0:6264:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c5f2c439/0x194cd781e88c80e9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114813.590433:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787114813.590439:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: 00000000bfc0ff16/0x194cd781e88c80a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c80aa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114813.590448:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bfc0ff16 already unused, calling callback (000000002174de54) 10000000:00010000:0.0:1787114813.590451:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: 00000000bfc0ff16/0x194cd781e88c80a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c80aa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114813.590458:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: 00000000bfc0ff16/0x194cd781e88c80a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c80aa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787114813.590464:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: 00000000bfc0ff16/0x194cd781e88c80a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c80aa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114813.590469:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787114813.590876:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: 00000000bfc0ff16/0x194cd781e88c80a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c80aa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114813.590884:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787114813.590956:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000051544d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624565504:0@lo:103: 00000100:00100000:2.0:1787114813.591006:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787114813.591307:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: 00000000bfc0ff16/0x194cd781e88c80a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c80aa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114813.591315:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: 00000000bfc0ff16/0x194cd781e88c80a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c80aa expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114813.591332:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114813.591335:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114813.591336:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114813.591367:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624565504 00000100:00100000:0.0:1787114813.591374:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624565504 00010000:00010000:0.0:1787114813.591397:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008866a462/0x194cd781e88c80aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c80a3 expref: 12 pid: 5780 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114813.591465:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787114813.591473:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026eaf66e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:3309:x1873925624565504:12345-0@lo:103: 00010000:00010000:0.0:1787114813.591486:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787114813.591490:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008866a462/0x194cd781e88c80aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c80a3 expref: 12 pid: 5780 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114813.591500:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008866a462/0x194cd781e88c80aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c80a3 expref: 12 pid: 5780 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114813.591513:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008866a462/0x194cd781e88c80aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c80a3 expref: 12 pid: 5780 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114813.591528:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c5f2c439/0x194cd781e88c80e9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114813.591535:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c5f2c439/0x194cd781e88c80e9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114813.591547:0:5771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c5f2c439/0x194cd781e88c80e9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114813.591554:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c5f2c439/0x194cd781e88c80e9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114813.591559:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c5f2c439/0x194cd781e88c80e9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114813.591574:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c5f2c439/0x194cd781e88c80e9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114813.591579:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c5f2c439 already unused, calling callback (0000000005e33454) 00010000:00010000:0.0:1787114813.591583:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c5f2c439/0x194cd781e88c80e9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114813.591590:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c5f2c439/0x194cd781e88c80e9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114813.591611:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c5f2c439/0x194cd781e88c80e9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114813.591692:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787114813.591745:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026eaf66e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:3309:x1873925624565504:12345-0@lo:103: Request processed in 273us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114813.591753:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787114813.591823:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000051544d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624565504:0@lo:103: 00010000:00010000:1.0:1787114813.591875:0:6264:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c5f2c439/0x194cd781e88c80e9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114813.591883:0:6264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c5f2c439/0x194cd781e88c80e9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114813.591889:0:6264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c5f2c439/0x194cd781e88c80e9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114813.637221:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787114813.829541:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787114813.829563:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000825f8cbd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624565632:0@lo:400: 00000100:00100000:3.0:1787114813.829617:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114813.829826:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624565632 00000100:00100000:0.0:1787114813.829836:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624565632 00000100:00100000:0.0:1787114813.832022:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787114813.832039:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b6180e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624565632:12345-0@lo:400: 00000100:00100000:0.0:1787114813.832161:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b6180e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624565632:12345-0@lo:400: Request processed in 127us (2542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114813.832169:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787114813.832948:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000825f8cbd x1873925624565632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787114829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114813.832979:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000825f8cbd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624565632:0@lo:400: 00010000:00010000:1.0:1787114814.664747:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787114815.686401:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114816.710598:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787114817.733234:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114818.758229:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787114818.953311:0:5782:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787114818.953317:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af05032f000 from 1 10000000:01000000:1.0:1787114818.953322:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787114818.953367:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: 000000003a910b37/0x194cd781e88c80f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114818.953380:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: 000000003a910b37/0x194cd781e88c80f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114818.953390:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: 000000003a910b37/0x194cd781e88c80f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114818.953412:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005954d116 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624565760:0@lo:101: 00000100:00100000:1.0:1787114818.953478:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114818.953541:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b96f4913 going to sleep for 11 seconds 00000100:00100000:2.0:1787114818.953772:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624565760 00000100:00100000:2.0:1787114818.953781:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624565760 00000100:00100000:2.0:1787114818.953839:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787114818.953846:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9a9b81e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:5782:x1873925624565760:12345-0@lo:101: 00010000:00010000:2.0:1787114818.953860:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114818.953880:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000be43e47c/0x194cd781e88c80f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c80f0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114818.953932:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000be43e47c/0x194cd781e88c80f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c80f0 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114818.953942:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000be43e47c/0x194cd781e88c80f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c80f0 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114818.953951:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000be43e47c, rc 0) 00000100:00100000:2.0:1787114818.953993:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9a9b81e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:5782:x1873925624565760:12345-0@lo:101: Request processed in 147us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114818.954000:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787114818.954043:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005954d116 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624565760:0@lo:101: 00010000:00010000:2.0:1787114818.954057:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: 000000003a910b37/0x194cd781e88c80f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c80f7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114818.954065:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: 000000003a910b37/0x194cd781e88c80f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c80f7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114818.954139:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009070b7ab pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624565888:0@lo:501: 00000100:00100000:2.0:1787114818.954165:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114818.954185:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set 000000006d3161d8 going to sleep for 11 seconds 00000100:00100000:1.0:1787114818.954433:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624565888 00000100:00100000:1.0:1787114818.954444:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624565888 00000100:00100000:1.0:1787114818.954475:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787114818.954481:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d5d40ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:5782:x1873925624565888:12345-0@lo:501: 00000100:00100000:1.0:1787114818.954811:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d5d40ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:5782:x1873925624565888:12345-0@lo:501: Request processed in 330us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114818.954819:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787114818.956395:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009070b7ab pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624565888:0@lo:501: 00000100:00100000:2.0:1787114818.956450:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009070b7ab pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624566016:0@lo:503: 00000100:00100000:2.0:1787114818.956519:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114818.956575:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set 000000006d3161d8 going to sleep for 11 seconds 00000100:00100000:3.0:1787114818.957150:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624566016 00000100:00100000:3.0:1787114818.957158:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624566016 00000100:00100000:3.0:1787114818.957201:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787114818.957208:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098e59131 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:5782:x1873925624566016:12345-0@lo:503: 00000100:00100000:3.0:1787114818.957554:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098e59131 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:5782:x1873925624566016:12345-0@lo:503: Request processed in 346us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114818.957574:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787114818.957639:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009070b7ab pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624566016:0@lo:503: 00000100:00100000:2.0:1787114818.959891:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004ecccafc pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:6574:1873925624566144:0@lo:502: 00000100:00100000:2.0:1787114818.959981:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114818.960022:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set 000000006d3161d8 going to sleep for 11 seconds 00000100:00100000:1.0:1787114818.960133:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624566144 00000100:00100000:1.0:1787114818.960141:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624566144 00000100:00100000:1.0:1787114818.960195:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787114818.960203:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e4c905e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:6574:x1873925624566144:12345-0@lo:502: 00000100:00100000:1.0:1787114818.960414:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e4c905e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:6574:x1873925624566144:12345-0@lo:502: Request processed in 213us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114818.960422:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787114818.962206:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787114818.962225:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064b3049b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624566272:0@lo:400: 00000100:00100000:2.0:1787114818.962281:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114818.962353:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004ecccafc pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:6574:1873925624566144:0@lo:502: 00000020:01000000:2.0:1787114818.962387:0:6574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787114818.962396:0:6574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787114818.962399:0:6574:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787114818.962406:0:6574:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8af05032f000 00000020:00000080:2.0:1787114818.962409:0:6574:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787114818.962454:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:6574:1873925624566400:0@lo:502: 00000100:00100000:2.0:1787114818.962496:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114818.962524:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624566400 00000100:00100000:2.0:1787114818.962530:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624566400 00000100:00100000:1.0:1787114818.962895:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624566272 00000100:00100000:1.0:1787114818.962900:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624566272 00000100:00100000:1.0:1787114818.962959:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787114818.962968:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624566272:12345-0@lo:400: 00000100:00100000:2.0:1787114818.963037:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787114818.963045:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:6574:x1873925624566400:12345-0@lo:502: 00000100:00100000:1.0:1787114818.968135:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624566272:12345-0@lo:400: Request processed in 5160us (5845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114818.968151:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787114818.971843:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8af042cb9880 x1873925624566272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787114834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114818.971862:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624566272:0@lo:400: 00000100:00100000:2.0:1787114818.972146:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:6574:x1873925624566400:12345-0@lo:502: Request processed in 9100us (9648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114818.972156:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787114818.972230:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050797000 going to sleep for 11 seconds 00000100:00100000:2.0:1787114818.972244:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:6574:1873925624566400:0@lo:502: 00000020:01000000:2.0:1787114818.972273:0:6574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787114818.972288:0:6574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787114818.972290:0:6574:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787114818.972295:0:6574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787114818.972597:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787114818.972627:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787114818.972638:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041683000/0x194cd781e88c80f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c80f7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114818.972649:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af041683000/0x194cd781e88c80f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c80f7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787114819.183519:0:6572:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787114819.183523:0:6572:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787114819.183743:0:6572:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8af06f41d000 00000020:01000004:1.0:1787114819.183760:0:6572:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787114819.183770:0:6572:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787114819.183782:0:6572:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8af0483c0000) 00000020:00000080:1.0:1787114819.183796:0:6572:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787114819.212818:0:6572:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787114819.213328:0:6572:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787114819.249631:0:6572:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787114819.257527:0:6572:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787114819.257638:0:6572:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787114819.257724:0:6572:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787114819.257759:0:6572:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787114819.258312:0:6572:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787114819.258322:0:6572:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787114819.258333:0:6572:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x194cd781e88c8105 00000020:01000004:2.0:1787114819.258341:0:6572:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787114819.258428:0:6572:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.110@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787114819.258432:0:6572:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787114819.258439:0:6572:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787114819.258443:0:6572:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787114819.258462:0:6572:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8af06eea99c0) 00000020:00000080:2.0:1787114819.258473:0:6572:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787114819.259694:0:6572:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787114819.259843:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787114819.259856:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787114819.260766:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787114819.260774:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787114819.261243:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787114819.261250:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787114819.263319:0:6572:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787114819.263776:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787114819.263782:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787114819.271492:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787114819.271510:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787114819.315791:0:6572:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787114819.316262:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787114819.316270:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787114819.321593:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787114819.321772:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787114819.323217:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787114819.323230:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787114819.328531:0:6572:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787114819.328790:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787114819.328798:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787114819.329807:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787114819.329815:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787114819.423231:0:6572:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787114819.423422:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787114819.423428:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787114819.425686:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787114819.425699:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787114819.427008:0:6572:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787114819.427033:0:6572:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787114819.427039:0:6572:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.110@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787114819.454630:0:6572:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.110@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787114819.454666:0:6572:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.110@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787114819.454669:0:6572:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787114819.454671:0:6572:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787114819.454673:0:6572:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787114819.454674:0:6572:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787114819.454675:0:6572:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787114819.454676:0:6572:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787114819.454678:0:6572:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787114819.454679:0:6572:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787114819.454680:0:6572:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787114819.454682:0:6572:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787114819.454683:0:6572:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787114819.454687:0:6572:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787114819.454689:0:6572:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787114819.454690:0:6572:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787114819.454692:0:6572:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787114819.454693:0:6572:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787114819.454694:0:6572:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787114819.454695:0:6572:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787114819.454697:0:6572:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787114819.454698:0:6572:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787114819.454699:0:6572:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787114819.454700:0:6572:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787114819.454701:0:6572:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787114819.456326:0:6572:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787114819.456349:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051362300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624566528:0@lo:253: 00000100:00100000:0.0:1787114819.456560:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114819.456681:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624566528 00000100:00100000:2.0:1787114819.456689:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624566528 00000100:00100000:2.0:1787114819.456766:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787114819.456775:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:6572:x1873925624566528:12345-0@lo:253: 20000000:01000000:2.0:1787114819.456811:0:5779:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787114819.456816:0:5779:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787114819.456820:0:5779:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787114819.456824:0:5779:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000100:00100000:0.0:1787114819.456927:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04979b540 going to sleep for 11 seconds 00000040:00080000:2.0:1787114819.457749:0:5779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787114819.458629:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787114819.458644:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787114819.458690:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1787114819.458699:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787114819.458745:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1787114819.458797:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1787114819.462946:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787114819.462977:0:5779:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.110@tcp 20000000:01000000:2.0:1787114819.462979:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.110@tcp (null) (null) (null) 00000040:00080000:2.0:1787114819.463019:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787114819.463026:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787114819.463159:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787114819.463168:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.110@tcp (null) (null) 00000040:00080000:2.0:1787114819.463224:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787114819.463233:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787114819.463259:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787114819.463316:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1787114819.467994:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787114819.468022:0:5779:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.110@tcp 20000000:01000000:2.0:1787114819.468024:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.110@tcp (null) (null) (null) 00000040:00080000:3.0:1787114819.473578:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1787114819.473606:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787114819.473685:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787114819.473695:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.110@tcp (null) (null) 00000040:00080000:3.0:1787114819.473799:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787114819.473810:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787114819.473846:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1787114819.474221:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1787114819.474246:0:5779:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787114819.474249:0:5779:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787114819.474255:0:5779:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787114819.474257:0:5779:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787114819.474259:0:5779:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787114819.474272:0:5779:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787114819.474275:0:5779:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787114819.474318:0:5779:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787114819.474321:0:5779:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787114819.475783:0:6589:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787114819.475933:0:6589:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787114819.475991:0:6589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787114819.481720:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1787114819.481775:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1787114819.481810:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1787114819.481823:0:5779:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787114819.481826:0:5779:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787114819.489199:0:6590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1787114819.490177:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1787114819.490223:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1787114819.490324:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1787114819.490339:0:5779:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787114819.490341:0:5779:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787114819.491631:0:6591:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787114819.491685:0:6591:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787114819.491756:0:6591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787114819.492523:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787114819.492574:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787114819.492653:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:0.0:1787114819.492676:0:5779:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787114819.492696:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8af052365e00/0x194cd781e88c8113 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.492724:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af08216fa00/0x194cd781e88c802c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8025 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.492732:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af08216f800/0x194cd781e88c8048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8041 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.492737:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af0429ca000/0x194cd781e88c80b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c80b1 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.492745:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8af052365e00/0x194cd781e88c8113 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.492783:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af0429ca000/0x194cd781e88c80b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c80b1 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.492798:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af0429ca000/0x194cd781e88c80b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c80b1 expref: 12 pid: 5779 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114819.492812:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051361180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5779:1873925624566656:0@lo:104: 00000100:00100000:0.0:1787114819.492966:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787114819.493028:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af08216f800/0x194cd781e88c8048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c8041 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.493048:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af08216f800/0x194cd781e88c8048 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c8041 expref: 12 pid: 5778 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114819.493338:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051363b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5779:1873925624566784:0@lo:104: 00000100:00100000:0.0:1787114819.493536:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787114819.493635:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af08216fa00/0x194cd781e88c802c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c8025 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.493644:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af08216fa00/0x194cd781e88c802c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c8025 expref: 12 pid: 5778 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114819.493653:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051363800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5779:1873925624566912:0@lo:104: 00000100:00100000:0.0:1787114819.493674:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114819.499246:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051051600 going to sleep for 11 seconds 00000100:00100000:2.0:1787114819.513970:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624566656 00000100:00100000:2.0:1787114819.513986:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624566656 00000100:00100000:2.0:1787114819.514047:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624566784 00000100:00100000:2.0:1787114819.514050:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624566784 00000100:00100000:2.0:1787114819.514134:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624566912 00000100:00100000:2.0:1787114819.514138:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624566912 00000100:00100000:2.0:1787114819.514288:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787114819.514298:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051363480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+5:5779:x1873925624566656:12345-0@lo:104: 00010000:00010000:2.0:1787114819.514316:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af0429cb200/0x194cd781e88c80b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c80b8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.514591:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787114819.514598:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051363480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+5:5779:x1873925624566656:12345-0@lo:104: Request processed in 302us (21632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114819.514605:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787114819.514624:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787114819.514630:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051362d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+4:5779:x1873925624566784:12345-0@lo:104: 00010000:00010000:2.0:1787114819.514638:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8048 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.514672:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787114819.514677:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051362d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+4:5779:x1873925624566784:12345-0@lo:104: Request processed in 48us (21142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114819.514683:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787114819.514695:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787114819.514701:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051361880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:5779:x1873925624566912:12345-0@lo:104: 00010000:00010000:2.0:1787114819.514719:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c802c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.514746:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787114819.514751:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051361880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:5779:x1873925624566912:12345-0@lo:104: Request processed in 51us (21076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114819.514766:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787114819.514805:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787114819.514811:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af0429cb200/0x194cd781e88c80b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c80b8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.514819:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cb200 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1787114819.514824:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af0429cb200/0x194cd781e88c80b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c80b8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.514831:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af0429cb200/0x194cd781e88c80b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c80b8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787114819.514839:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af0429cb200/0x194cd781e88c80b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c80b8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787114819.514845:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787114819.514972:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051361180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5779:1873925624566656:0@lo:104: 00000100:00100000:3.0:1787114819.514983:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051363b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5779:1873925624566784:0@lo:104: 00000100:00100000:3.0:1787114819.515001:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051363800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5779:1873925624566912:0@lo:104: 00010000:00010000:3.0:1787114819.515026:0:5779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8af052365e00/0x194cd781e88c8113 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.515679:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af0429cb200/0x194cd781e88c80b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c80b8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.515689:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787114819.515742:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624567040:0@lo:103: 00000100:00100000:3.0:1787114819.515785:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787114819.515856:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af0429cb200/0x194cd781e88c80b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c80b8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.515873:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af0429cb200/0x194cd781e88c80b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c80b8 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.515890:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787114819.515893:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8048 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.515911:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052365200 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1787114819.515915:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c8048 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.515922:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8041 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c8048 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787114819.515929:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8041 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c8048 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787114819.515934:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787114819.515949:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8041 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8048 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.515955:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787114819.516959:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624567040 00000100:00100000:1.0:1787114819.516968:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624567040 00010000:00010000:1.0:1787114819.516995:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af0429ca000/0x194cd781e88c80b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c80b1 expref: 13 pid: 5779 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114819.517025:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787114819.517032:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:3308:x1873925624567040:12345-0@lo:103: 00010000:00010000:1.0:1787114819.517043:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787114819.517048:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af0429ca000/0x194cd781e88c80b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c80b1 expref: 13 pid: 5779 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114819.517071:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af0429ca000/0x194cd781e88c80b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c80b1 expref: 13 pid: 5779 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114819.517085:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af0429ca000/0x194cd781e88c80b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c80b1 expref: 13 pid: 5779 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114819.517103:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787114819.517222:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624567168:0@lo:103: 00000100:00100000:0.0:1787114819.517255:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114819.517303:0:5771:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787114819.517310:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787114819.521159:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624567168 00000100:00100000:0.0:1787114819.521172:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624567168 00010000:00010000:0.0:1787114819.521209:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af08216f800/0x194cd781e88c8048 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8041 expref: 13 pid: 5778 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114819.521242:0:5771:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787114819.521254:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787114819.521262:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:3309:x1873925624567168:12345-0@lo:103: 00010000:00010000:0.0:1787114819.521275:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787114819.521280:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af08216f800/0x194cd781e88c8048 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8041 expref: 13 pid: 5778 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.521307:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af08216f800/0x194cd781e88c8048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c8041 expref: 13 pid: 5778 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.521324:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af08216f800/0x194cd781e88c8048 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c8041 expref: 13 pid: 5778 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.521338:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787114819.521761:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:3309:x1873925624567168:12345-0@lo:103: Request processed in 499us (4504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114819.521769:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787114819.521825:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624567168:0@lo:103: 00010000:00010000:2.0:1787114819.524153:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8041 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8048 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.524168:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8041 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8048 expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.524185:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787114819.524189:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c802c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.524196:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cb000 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1787114819.524199:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c802c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.524226:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c802c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787114819.524234:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c802c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787114819.524240:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787114819.524272:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8025 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c802c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.524278:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787114819.524306:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8025 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c802c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.524313:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8025 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c802c expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.524329:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114819.524330:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114819.524332:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114819.524341:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114819.524376:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787114819.524635:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624567296:0@lo:103: 00000100:00100000:2.0:1787114819.524696:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114819.525242:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624567296 00000100:00100000:0.0:1787114819.525250:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624567296 00010000:00010000:0.0:1787114819.525276:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af08216fa00/0x194cd781e88c802c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8025 expref: 12 pid: 5778 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114819.525305:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787114819.525313:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:3307:x1873925624567296:12345-0@lo:103: 00010000:00010000:0.0:1787114819.525324:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787114819.525329:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af08216fa00/0x194cd781e88c802c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8025 expref: 12 pid: 5778 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.525340:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af08216fa00/0x194cd781e88c802c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c8025 expref: 12 pid: 5778 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.525352:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af08216fa00/0x194cd781e88c802c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c8025 expref: 12 pid: 5778 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.525402:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8af052365e00/0x194cd781e88c8113 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.525411:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af052365e00/0x194cd781e88c8113 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.525426:0:5771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af052365e00/0x194cd781e88c8113 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.525433:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af052365e00/0x194cd781e88c8113 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.525440:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8af052365e00/0x194cd781e88c8113 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.525446:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8af052365e00/0x194cd781e88c8113 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.525452:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052365e00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787114819.525456:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8af052365e00/0x194cd781e88c8113 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.525618:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8af052365e00/0x194cd781e88c8113 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.525638:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8af052365e00/0x194cd781e88c8113 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.525648:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787114819.525691:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:3307:x1873925624567296:12345-0@lo:103: Request processed in 379us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114819.525718:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787114819.525913:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bfcc0b7-8035-40e1-91c8-e687d170788c+10:3308:x1873925624567040:12345-0@lo:103: Request processed in 8880us (10126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114819.525922:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787114819.526414:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624567296:0@lo:103: 00010000:00010000:2.0:1787114819.526455:0:5779:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8af052365e00/0x194cd781e88c8113 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.526620:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8af052365e00/0x194cd781e88c8113 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.526637:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af052365e00/0x194cd781e88c8113 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787114819.526651:0:5779:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787114819.546289:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624567040:0@lo:103: 00000100:00100000:3.0:1787114819.664277:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+9:6572:x1873925624566528:12345-0@lo:253: Request processed in 207495us (207709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114819.664290:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787114819.664646:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051362300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624566528:0@lo:253: 10000000:01000000:0.0:1787114819.664662:0:6572:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787114819.664665:0:6572:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787114819.664667:0:6572:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787114819.664668:0:6572:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787114819.664669:0:6572:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1787114819.664671:0:6572:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787114819.664672:0:6572:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787114819.664674:0:6572:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787114819.664676:0:6572:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787114819.664677:0:6572:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787114819.664678:0:6572:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787114819.664698:0:6572:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8af06f41d000 from lustre-OST0000 10000000:01000000:0.0:1787114819.664733:0:6572:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787114819.664736:0:6572:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787114819.664743:0:6572:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8af05916cd40 local copy 10000000:01000000:0.0:1787114819.664748:0:6572:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787114819.664783:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c811a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.664794:0:6572:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c811a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.664804:0:6572:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c811a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114819.664821:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051362300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624567424:0@lo:101: 00000100:00100000:0.0:1787114819.664855:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114819.666677:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0510516c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787114819.666793:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624567424 00000100:00100000:2.0:1787114819.666802:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624567424 00000100:00100000:2.0:1787114819.666844:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787114819.666853:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+9:6572:x1873925624567424:12345-0@lo:101: 00010000:00010000:2.0:1787114819.666878:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114819.666896:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af08216f200/0x194cd781e88c8121 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c811a expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.666921:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af08216f200/0x194cd781e88c8121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c811a expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.666931:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af08216f200/0x194cd781e88c8121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c811a expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.666940:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216f200, rc 0) 00000100:00100000:2.0:1787114819.666994:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+10:6572:x1873925624567424:12345-0@lo:101: Request processed in 142us (2138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114819.667000:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787114819.667333:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051362300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624567424:0@lo:101: 00010000:00010000:0.0:1787114819.667434:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c811a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x194cd781e88c8121 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.667443:0:6572:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c811a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x194cd781e88c8121 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114819.667549:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051362300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624567552:0@lo:501: 00000100:00100000:0.0:1787114819.667581:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114819.667612:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0510516c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787114819.673194:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624567552 00000100:00100000:3.0:1787114819.673208:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624567552 00000100:00100000:3.0:1787114819.673275:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787114819.673285:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+10:6572:x1873925624567552:12345-0@lo:501: 00000100:00100000:3.0:1787114819.673764:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+10:6572:x1873925624567552:12345-0@lo:501: Request processed in 479us (6181us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787114819.673773:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787114819.673899:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051362300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624567552:0@lo:501: 10000000:01000000:0.0:1787114819.673924:0:6572:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787114819.673958:0:6572:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787114819.673965:0:6572:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c811a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x194cd781e88c8121 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.673975:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c811a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x194cd781e88c8121 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.673983:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c811a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x194cd781e88c8121 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.674006:0:6572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787114819.674027:0:6572:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8af06f41d000 10000000:01000000:0.0:1787114819.674032:0:6572:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787114819.674037:0:6572:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8af05916cd40 10000000:01000000:0.0:1787114819.674040:0:6572:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787114819.674043:0:6572:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8af05916cd40 from 1 10000000:01000000:0.0:1787114819.674046:0:6572:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787114819.674084:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365600/0x194cd781e88c8128 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.674099:0:6572:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af052365600/0x194cd781e88c8128 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.674162:0:6572:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af052365600/0x194cd781e88c8128 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114819.674181:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051362300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624567680:0@lo:101: 00000100:00100000:0.0:1787114819.674216:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114819.674246:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051051180 going to sleep for 11 seconds 00000100:00100000:1.0:1787114819.674466:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624567680 00000100:00100000:1.0:1787114819.674471:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624567680 00000100:00100000:1.0:1787114819.674511:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787114819.674519:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+10:6572:x1873925624567680:12345-0@lo:101: 00010000:00010000:1.0:1787114819.674529:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787114819.674542:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af041682800/0x194cd781e88c812f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8128 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114819.674572:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af041682800/0x194cd781e88c812f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8128 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114819.674584:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af041682800/0x194cd781e88c812f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8128 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114819.674593:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041682800, rc 0) 00000100:00100000:1.0:1787114819.674631:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:6572:x1873925624567680:12345-0@lo:101: Request processed in 112us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114819.674637:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1787114819.674781:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787114819.674788:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c811a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x194cd781e88c8121 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.674795:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052365a00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1787114819.674799:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c811a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x194cd781e88c8121 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.674814:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c811a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x194cd781e88c8121 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787114819.674822:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c811a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x194cd781e88c8121 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787114819.674827:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787114819.674847:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c811a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x194cd781e88c8121 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.674852:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787114819.674884:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c811a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x194cd781e88c8121 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.674891:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c811a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x194cd781e88c8121 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.674907:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114819.674910:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114819.674911:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114819.674955:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624567808:0@lo:103: 00000100:00100000:1.0:1787114819.674985:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114819.675173:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624567808 00000100:00100000:2.0:1787114819.675179:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624567808 00000100:00100000:2.0:1787114819.675209:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787114819.675215:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:3307:x1873925624567808:12345-0@lo:103: 00010000:00010000:2.0:1787114819.675225:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787114819.675237:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af08216f200/0x194cd781e88c8121 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x194cd781e88c811a expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.675250:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787114819.675284:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+10:3307:x1873925624567808:12345-0@lo:103: Request processed in 69us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114819.675291:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787114819.675468:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624567808:0@lo:103: 00000100:00100000:0.0:1787114819.679210:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051362300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624567680:0@lo:101: 00010000:00010000:0.0:1787114819.679237:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af052365600/0x194cd781e88c8128 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c812f expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.679249:0:6572:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af052365600/0x194cd781e88c8128 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c812f expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114819.679270:0:6572:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787114819.679285:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365600/0x194cd781e88c8128 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c812f expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.679294:0:6572:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af052365600/0x194cd781e88c8128 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c812f expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114819.679302:0:6572:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787114819.679312:0:6572:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787114819.679319:0:6572:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787114819.679322:0:6572:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787114819.679580:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c8136 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.679606:0:6572:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c8136 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.679617:0:6572:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c8136 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114819.679715:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051362300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624567936:0@lo:101: 00000100:00100000:1.0:1787114819.679774:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114819.679814:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051399900 going to sleep for 11 seconds 00000100:00100000:3.0:1787114819.682689:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624567936 00000100:00100000:3.0:1787114819.682712:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624567936 00000100:00100000:3.0:1787114819.682785:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787114819.682795:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+10:6572:x1873925624567936:12345-0@lo:101: 00010000:00010000:3.0:1787114819.682811:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787114819.682830:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af0429cbc00/0x194cd781e88c813d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8136 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114819.682855:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af0429cbc00/0x194cd781e88c813d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8136 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114819.682900:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af0429cbc00/0x194cd781e88c813d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8136 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114819.682908:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429cbc00, rc 0) 00000100:00100000:3.0:1787114819.682990:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:6572:x1873925624567936:12345-0@lo:101: Request processed in 197us (3216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114819.682996:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787114819.683280:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051362300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624567936:0@lo:101: 00010000:00010000:2.0:1787114819.683298:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c8136 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c813d expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.683308:0:6572:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c8136 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c813d expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114819.683428:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624568064:0@lo:501: 00000100:00100000:2.0:1787114819.683462:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114819.683496:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309d000 going to sleep for 11 seconds 00000100:00100000:3.0:1787114819.683604:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624568064 00000100:00100000:3.0:1787114819.683608:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624568064 00000100:00100000:3.0:1787114819.683638:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787114819.683644:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:6572:x1873925624568064:12345-0@lo:501: 00000100:00100000:3.0:1787114819.683886:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:6572:x1873925624568064:12345-0@lo:501: Request processed in 241us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114819.683893:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787114819.684497:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624568064:0@lo:501: 00000100:00100000:0.0:1787114819.684534:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051363100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624568192:0@lo:503: 00000100:00100000:0.0:1787114819.684580:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114819.684607:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051051180 going to sleep for 11 seconds 00000100:00100000:1.0:1787114819.684661:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624568192 00000100:00100000:1.0:1787114819.684666:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624568192 00000100:00100000:1.0:1787114819.684710:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787114819.684717:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:6572:x1873925624568192:12345-0@lo:503: 00000100:00100000:1.0:1787114819.684884:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:6572:x1873925624568192:12345-0@lo:503: Request processed in 167us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114819.684890:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787114819.685602:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051363100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624568192:0@lo:503: 00000040:00080000:1.0:1787114819.687202:0:6572:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787114819.687301:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cbb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624568320:0@lo:502: 00000100:00100000:1.0:1787114819.688494:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114819.688547:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051399540 going to sleep for 11 seconds 00000100:00100000:3.0:1787114819.689395:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624568320 00000100:00100000:3.0:1787114819.689404:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624568320 00000100:00100000:3.0:1787114819.689462:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787114819.689471:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:6572:x1873925624568320:12345-0@lo:502: 00000100:00100000:3.0:1787114819.689722:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:6572:x1873925624568320:12345-0@lo:502: Request processed in 251us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114819.689730:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787114819.689935:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cbb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624568320:0@lo:502: 00000040:00080000:1.0:1787114819.690301:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787114819.690565:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787114819.690609:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787114819.690659:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787114819.690698:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787114819.690744:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787114819.690781:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cbb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624568448:0@lo:502: 00000100:00100000:1.0:1787114819.690830:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114819.690866:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051399540 going to sleep for 11 seconds 00000100:00100000:0.0:1787114819.690995:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624568448 00000100:00100000:0.0:1787114819.691002:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624568448 00000100:00100000:0.0:1787114819.691036:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787114819.691045:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:6572:x1873925624568448:12345-0@lo:502: 00000100:00100000:0.0:1787114819.691250:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:6572:x1873925624568448:12345-0@lo:502: Request processed in 205us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114819.691257:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787114819.691658:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cbb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624568448:0@lo:502: 00000040:00080000:1.0:1787114819.691751:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787114819.691761:0:6572:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1787114819.701240:0:6594:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787114819.701251:0:6594:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787114819.701257:0:6594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787114819.701259:0:6594:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787114819.701264:0:6594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787114819.701277:0:6594:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8af051304d40) 00000020:00000080:3.0:1787114819.701312:0:6594:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787114819.701317:0:6594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787114819.701384:0:6594:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af06f41d000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787114819.701391:0:6594:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787114819.701411:0:6594:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x194cd781e88c814b 00010000:00010000:3.0:1787114819.712099:0:6594:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1787114819.712446:0:6594:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787114819.714303:0:6594:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787114819.714524:0:6594:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787114819.740622:0:6594:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787114819.741329:0:6594:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787114819.758530:0:6594:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787114819.758543:0:6594:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787114819.758549:0:6594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787114819.758551:0:6594:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787114819.758554:0:6594:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787114819.758558:0:6594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787114819.758559:0:6594:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787114819.758562:0:6594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787114819.758564:0:6594:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787114819.758618:0:6594:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787114819.758622:0:6594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787114819.758623:0:6594:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787114819.758626:0:6594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787114819.758876:0:6572:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787114819.758902:0:6572:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787114819.758922:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c8136 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c813d expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114819.758935:0:6572:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c8136 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c813d expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787114819.758942:0:6572:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af06f41d000 from 1 10000000:01000000:1.0:1787114819.758946:0:6572:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787114819.758978:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c8152 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114819.758986:0:6572:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c8152 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114819.759004:0:6572:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c8152 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114819.759025:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cbb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624568576:0@lo:101: 00000100:00100000:1.0:1787114819.759104:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114819.759185:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051399540 going to sleep for 11 seconds 00000100:00100000:3.0:1787114819.759731:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624568576 00000100:00100000:3.0:1787114819.759739:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624568576 00000100:00100000:3.0:1787114819.759778:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787114819.759786:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:6572:x1873925624568576:12345-0@lo:101: 00010000:00010000:3.0:1787114819.759799:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787114819.759811:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af0429ca600/0x194cd781e88c8159 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8152 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114819.759834:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af0429ca600/0x194cd781e88c8159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8152 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114819.761428:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af0429ca600/0x194cd781e88c8159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8152 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114819.761443:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429ca600, rc 0) 00000100:00100000:3.0:1787114819.761513:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:6572:x1873925624568576:12345-0@lo:101: Request processed in 1726us (2408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114819.761521:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787114819.762292:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cbb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624568576:0@lo:101: 00010000:00010000:1.0:1787114819.762313:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c8152 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8159 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114819.762324:0:6572:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c8152 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8159 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114819.762446:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cbb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624568704:0@lo:501: 00000100:00100000:1.0:1787114819.762482:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114819.762513:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051399540 going to sleep for 11 seconds 00000100:00100000:3.0:1787114819.763007:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624568704 00000100:00100000:3.0:1787114819.763014:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624568704 00000100:00100000:3.0:1787114819.763068:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787114819.763076:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:6572:x1873925624568704:12345-0@lo:501: 00000100:00100000:2.0:1787114819.763571:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:6572:x1873925624568704:12345-0@lo:501: Request processed in 494us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114819.763580:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787114819.764025:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cbb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624568704:0@lo:501: 00000100:00100000:1.0:1787114819.764473:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cbb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624568832:0@lo:503: 00000100:00100000:1.0:1787114819.764524:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114819.764558:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051399540 going to sleep for 11 seconds 00000100:00100000:2.0:1787114819.764614:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624568832 00000100:00100000:2.0:1787114819.764620:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624568832 00000100:00100000:2.0:1787114819.764661:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787114819.764668:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:6572:x1873925624568832:12345-0@lo:503: 00000100:00100000:2.0:1787114819.765067:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:6572:x1873925624568832:12345-0@lo:503: Request processed in 386us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114819.765076:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787114819.777439:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cbb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624568832:0@lo:503: 00000040:00080000:2.0:1787114819.777853:0:6572:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787114819.778448:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624568960:0@lo:502: 00000100:00100000:2.0:1787114819.778521:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114819.778573:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787114819.779895:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624568960 00000100:00100000:1.0:1787114819.779904:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624568960 00000100:00100000:1.0:1787114819.779953:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787114819.779963:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:6572:x1873925624568960:12345-0@lo:502: 00000100:00100000:1.0:1787114819.780220:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:6572:x1873925624568960:12345-0@lo:502: Request processed in 258us (1698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114819.780234:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787114819.782327:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624568960:0@lo:502: 00000040:00080000:2.0:1787114819.782644:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787114819.782718:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787114819.782756:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624569088:0@lo:502: 00000100:00100000:2.0:1787114819.782810:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114819.782851:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309df00 going to sleep for 11 seconds 00000100:00100000:3.0:1787114819.783281:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624569088 00000100:00100000:3.0:1787114819.783287:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624569088 00000100:00100000:3.0:1787114819.783325:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787114819.783334:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:6572:x1873925624569088:12345-0@lo:502: 00000100:00100000:3.0:1787114819.783517:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:6572:x1873925624569088:12345-0@lo:502: Request processed in 183us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114819.783525:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1787114819.783661:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114819.786259:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624569088:0@lo:502: 00000040:00080000:2.0:1787114819.786686:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787114819.786713:0:6572:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787114819.787762:0:6598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787114819.787772:0:6598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787114819.787775:0:6598:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787114819.787782:0:6598:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8af06f41d000 00000020:00000080:1.0:1787114819.787785:0:6598:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787114819.787800:0:6598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787114819.787803:0:6598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787114819.787805:0:6598:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787114819.787807:0:6598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787114819.787995:0:6572:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787114819.788014:0:6572:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787114819.788038:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c8152 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8159 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114819.788049:0:6572:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c8152 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8159 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787114819.788268:0:6572:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787114819.788272:0:6572:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8af06f41d000 10000000:01000000:3.0:1787114819.788275:0:6572:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8af06f41d000 10000000:01000000:3.0:1787114819.788279:0:6572:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787114819.788285:0:6572:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8af06f41d000 from 1 10000000:01000000:3.0:1787114819.788288:0:6572:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787114819.788320:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c8160 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114819.788328:0:6572:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c8160 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114819.788339:0:6572:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c8160 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114819.788370:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624569216:0@lo:101: 00000100:00100000:3.0:1787114819.788426:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114819.788463:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624569216 00000100:00100000:3.0:1787114819.788468:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624569216 00000100:00100000:3.0:1787114819.788506:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787114819.788513:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:6572:x1873925624569216:12345-0@lo:101: 00010000:00010000:3.0:1787114819.788526:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787114819.788537:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af0429ca800/0x194cd781e88c8167 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8160 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114819.788558:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af0429ca800/0x194cd781e88c8167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8160 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114819.788568:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af0429ca800/0x194cd781e88c8167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8160 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114819.788583:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429ca800, rc 0) 00000100:00100000:3.0:1787114819.788615:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:6572:x1873925624569216:12345-0@lo:101: Request processed in 102us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114819.788621:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787114819.788663:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0462ba480 going to sleep for 11 seconds 00000100:00100000:3.0:1787114819.788682:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624569216:0@lo:101: 00010000:00010000:3.0:1787114819.788695:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c8160 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8167 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114819.788720:0:6572:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c8160 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8167 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114819.788804:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624569344:0@lo:501: 00000100:00100000:3.0:1787114819.788828:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114819.788839:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0462ba480 going to sleep for 11 seconds 00000100:00100000:1.0:1787114819.789314:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624569344 00000100:00100000:1.0:1787114819.789319:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624569344 00000100:00100000:1.0:1787114819.789347:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787114819.789365:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:6572:x1873925624569344:12345-0@lo:501: 00000100:00100000:1.0:1787114819.789563:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:6572:x1873925624569344:12345-0@lo:501: Request processed in 199us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114819.789571:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787114819.791512:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624569344:0@lo:501: 00000100:00100000:3.0:1787114819.791568:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624569472:0@lo:503: 00000100:00100000:3.0:1787114819.791626:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114819.791668:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0462ba480 going to sleep for 11 seconds 00000100:00100000:0.0:1787114819.792236:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624569472 00000100:00100000:0.0:1787114819.792243:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624569472 00000100:00100000:0.0:1787114819.792289:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787114819.792297:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:6572:x1873925624569472:12345-0@lo:503: 00000100:00100000:0.0:1787114819.792500:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:6572:x1873925624569472:12345-0@lo:503: Request processed in 203us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114819.792507:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787114819.792813:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624569472:0@lo:503: 00000040:00080000:3.0:1787114819.794035:0:6572:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787114819.795319:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624569600:0@lo:502: 00000100:00100000:3.0:1787114819.795623:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114819.796999:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0462ba480 going to sleep for 11 seconds 00000100:00100000:0.0:1787114819.802658:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624569600 00000100:00100000:0.0:1787114819.802672:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624569600 00000100:00100000:0.0:1787114819.803049:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787114819.803307:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:6572:x1873925624569600:12345-0@lo:502: 00000100:00100000:0.0:1787114819.803654:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:6572:x1873925624569600:12345-0@lo:502: Request processed in 595us (8030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114819.803662:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787114819.809086:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624569600:0@lo:502: 00000040:00080000:2.0:1787114819.809673:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787114819.809746:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787114819.809779:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787114819.809825:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787114819.809978:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787114819.810032:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787114819.812219:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787114819.812295:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787114819.813007:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787114819.813054:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787114819.813087:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787114819.813180:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787114819.813217:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787114819.813250:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787114819.813309:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787114819.813346:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787114819.813392:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787114819.813438:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787114819.813485:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787114819.813521:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787114819.813584:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787114819.813623:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787114819.813733:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787114819.813784:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787114819.813818:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787114819.813852:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787114819.814026:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787114819.814076:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787114819.814151:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624569728:0@lo:502: 00000100:00100000:2.0:1787114819.814224:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114819.814275:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787114819.814748:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624569728 00000100:00100000:1.0:1787114819.814756:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624569728 00000100:00100000:1.0:1787114819.814806:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787114819.814815:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:6572:x1873925624569728:12345-0@lo:502: 00000100:00100000:1.0:1787114819.815207:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:6572:x1873925624569728:12345-0@lo:502: Request processed in 392us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114819.815216:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787114819.815472:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624569728:0@lo:502: 00000040:00080000:2.0:1787114819.815553:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787114819.815567:0:6572:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787114819.816241:0:6599:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787114819.816256:0:6599:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8af0483c4d40) 00000020:00000080:1.0:1787114819.816277:0:6599:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1787114819.816637:0:6599:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af06f41d000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787114819.816641:0:6599:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8af06f41d000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787114819.816644:0:6599:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af06f41d000 3 00010000:00080000:1.0:1787114819.816671:0:6599:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8af077f9a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.110@tcp at head 00010000:00010000:1.0:1787114819.832217:0:6599:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1787114819.832315:0:6599:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787114819.832468:0:6599:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787114819.832483:0:6599:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x194cd781e88c8175 00000100:00080000:1.0:1787114819.832493:0:6599:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787114819.832498:0:6599:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8af077f9a800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:1.0:1787114819.832534:0:6599:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af042cb8e00 x1873925624569856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787114819.832561:0:6599:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787114819.832928:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787114819.832943:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624569984:0@lo:400: 00000100:00100000:3.0:1787114819.832944:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1873925624569856:0@lo:38: 00000040:00080000:1.0:1787114819.835731:0:6599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1787114819.835987:0:6572:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787114819.836015:0:6572:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787114819.836037:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c8160 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8167 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.836048:0:6572:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c8160 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8167 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787114819.836097:0:6572:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787114819.836100:0:6572:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787114819.836101:0:6572:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787114819.836102:0:6572:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787114819.836264:0:6572:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787114819.836267:0:6572:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787114819.836269:0:6572:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787114819.836270:0:6572:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787114819.836277:0:6572:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787114819.836278:0:6572:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787114819.836279:0:6572:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787114819.836284:0:6572:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787114819.836286:0:6572:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787114819.836287:0:6572:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787114819.836288:0:6572:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787114819.836289:0:6572:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787114819.836290:0:6572:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787114819.836291:0:6572:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787114819.836292:0:6572:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787114819.836293:0:6572:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787114819.836294:0:6572:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787114819.836295:0:6572:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787114819.836296:0:6572:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787114819.836318:0:6572:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787114819.836335:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624570112:0@lo:253: 00000100:00100000:3.0:1787114819.839655:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114819.841172:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624569856 00000100:00100000:1.0:1787114819.841184:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624569856 00000100:00100000:1.0:1787114819.841243:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787114819.841252:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1873925624569856:12345-0@lo:38: 00010000:00080000:1.0:1787114819.841283:0:5786:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:1.0:1787114819.841321:0:5786:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x194cd781e88c817c 00000004:00100000:1.0:1787114819.841339:0:5786:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787114819.841388:0:5786:0:(import.c:65:import_set_state_nolock()) ffff8af077f9b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787114819.841467:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873925624569856:12345-0@lo:38: Request processed in 214us (1818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114819.841475:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787114819.841525:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af042cb8e00 x1873925624569856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787114829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114819.841537:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787114819.841563:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787114819.841573:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787114819.841579:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787114819.841581:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af077f9a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787114819.841588:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1873925624569856:0@lo:38: 00000100:00100000:0.0:1787114819.849045:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114819.850015:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624569984 00000100:00100000:1.0:1787114819.850027:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624569984 00000100:00100000:1.0:1787114819.850093:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787114819.850103:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624569984:12345-0@lo:400: 00000100:00100000:1.0:1787114819.850998:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624569984:12345-0@lo:400: Request processed in 895us (1958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114819.851007:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787114819.851086:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af051363100 x1873925624569984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787114835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114819.851101:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624569984:0@lo:400: 00000100:00100000:2.0:1787114819.851800:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114819.851835:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309d000 going to sleep for 11 seconds 00000100:00100000:0.0:1787114819.851861:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624570112 00000100:00100000:0.0:1787114819.851869:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624570112 00000100:00100000:0.0:1787114819.851912:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787114819.851920:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:6572:x1873925624570112:12345-0@lo:253: 20000000:01000000:0.0:1787114819.851944:0:5779:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787114819.851957:0:5779:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787114819.901445:0:5779:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787114819.901466:0:5779:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787114819.901566:0:5801:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787114819.901570:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787114819.901593:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8af041682c00/0x194cd781e88c8183 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114819.901622:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af0429cba00/0x194cd781e88c80e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c80db expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114819.901630:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8af041682c00/0x194cd781e88c8183 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114819.901669:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af0429cba00/0x194cd781e88c80e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c80db expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114819.901714:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af0429cba00/0x194cd781e88c80e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c80db expref: 13 pid: 5778 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114819.901732:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5801:1873925624570240:0@lo:104: 00000100:00100000:1.0:1787114819.901796:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114819.902035:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624570240 00000100:00100000:2.0:1787114819.902043:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624570240 00000100:00100000:2.0:1787114819.902093:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787114819.902102:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:5801:x1873925624570240:12345-0@lo:104: 00010000:00010000:2.0:1787114819.902136:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af052364400/0x194cd781e88c80db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c80e2 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.902184:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787114819.902190:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:5801:x1873925624570240:12345-0@lo:104: Request processed in 90us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114819.902197:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787114819.902218:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787114819.902224:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af052364400/0x194cd781e88c80db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c80e2 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.902241:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364400 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1787114819.902245:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af052364400/0x194cd781e88c80db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c80e2 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.902254:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af052364400/0x194cd781e88c80db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c80e2 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787114819.902261:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af052364400/0x194cd781e88c80db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c80e2 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787114819.902268:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787114819.902296:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af052364400/0x194cd781e88c80db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c80e2 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.902302:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787114819.902319:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af052364400/0x194cd781e88c80db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c80e2 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.902326:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af052364400/0x194cd781e88c80db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c80e2 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114819.902345:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114819.902347:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114819.902349:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114819.902478:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051399cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787114819.902502:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5801:1873925624570240:0@lo:104: 00010000:00010000:1.0:1787114819.902519:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8af041682c00/0x194cd781e88c8183 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114819.902546:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624570368:0@lo:103: 00000100:00100000:1.0:1787114819.902579:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114819.902682:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624570368 00000100:00100000:0.0:1787114819.902686:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624570368 00010000:00010000:0.0:1787114819.902715:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af0429cba00/0x194cd781e88c80e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c80db expref: 14 pid: 5778 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114819.902746:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787114819.902753:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:3309:x1873925624570368:12345-0@lo:103: 00010000:00010000:0.0:1787114819.902763:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787114819.902768:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af0429cba00/0x194cd781e88c80e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c80db expref: 14 pid: 5778 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.902779:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af0429cba00/0x194cd781e88c80e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c80db expref: 14 pid: 5778 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.902804:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af0429cba00/0x194cd781e88c80e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c80db expref: 14 pid: 5778 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.902816:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8af041682c00/0x194cd781e88c8183 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.902834:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af041682c00/0x194cd781e88c8183 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787114819.902846:0:6592:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006140159s 00010000:00010000:0.0:1787114819.902850:0:6592:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af041682c00/0x194cd781e88c8183 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.902857:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af041682c00/0x194cd781e88c8183 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.902871:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8af041682c00/0x194cd781e88c8183 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.902878:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8af041682c00/0x194cd781e88c8183 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.902885:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682c00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787114819.902889:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8af041682c00/0x194cd781e88c8183 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.902897:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8af041682c00/0x194cd781e88c8183 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.902911:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8af041682c00/0x194cd781e88c8183 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114819.902930:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787114819.902960:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:3309:x1873925624570368:12345-0@lo:103: Request processed in 207us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114819.902967:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787114819.903217:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624570368:0@lo:103: 00010000:00010000:1.0:1787114819.903241:0:5801:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8af041682c00/0x194cd781e88c8183 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114819.903249:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8af041682c00/0x194cd781e88c8183 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114819.903255:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af041682c00/0x194cd781e88c8183 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114819.932493:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:6572:x1873925624570112:12345-0@lo:253: Request processed in 80566us (80686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114819.932508:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787114819.932579:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:6572:1873925624570112:0@lo:253: 10000000:01000000:1.0:1787114819.932610:0:6572:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787114819.932614:0:6572:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787114819.932615:0:6572:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787114819.932617:0:6572:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787114819.932618:0:6572:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787114819.932619:0:6572:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787114819.932621:0:6572:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787114819.932622:0:6572:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787114819.932624:0:6572:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787114819.932625:0:6572:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787114819.932627:0:6572:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787114819.932628:0:6572:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787114819.932642:0:6572:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787114819.941718:0:6572:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787114819.944138:0:6572:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787114819.944379:0:6572:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787114819.944589:0:6572:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787114819.944804:0:6572:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787114819.949599:0:6572:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787114819.954318:0:6572:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787114820.217891:0:6572:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787114820.217899:0:6572:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787114820.217929:0:6572:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787114820.217987:0:6572:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.110@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787114820.218002:0:6572:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787114820.218033:0:6572:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787114820.805539:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114821.833721:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114822.853271:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114823.877464:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114824.903799:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787114825.094181:0:5782:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787114825.094190:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8af05032f000 from 21 10000000:01000000:1.0:1787114825.094195:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787114825.094234:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041683800/0x194cd781e88c818a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114825.094251:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af041683800/0x194cd781e88c818a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114825.094262:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af041683800/0x194cd781e88c818a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114825.094285:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624570496:0@lo:101: 00000100:00100000:1.0:1787114825.094352:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114825.094393:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050faaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787114825.094413:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624570496 00000100:00100000:1.0:1787114825.094419:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624570496 00000100:00100000:1.0:1787114825.094461:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787114825.094469:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:5782:x1873925624570496:12345-0@lo:101: 00010000:00010000:1.0:1787114825.094482:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787114825.094493:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af041683e00/0x194cd781e88c8191 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c818a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114825.094516:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af041683e00/0x194cd781e88c8191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c818a expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114825.094526:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af041683e00/0x194cd781e88c8191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c818a expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114825.094535:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041683e00, rc 0) 00000100:00100000:1.0:1787114825.094566:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:5782:x1873925624570496:12345-0@lo:101: Request processed in 98us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114825.094572:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787114825.098355:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624570496:0@lo:101: 00010000:00010000:1.0:1787114825.098455:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af041683800/0x194cd781e88c818a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8191 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114825.098469:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af041683800/0x194cd781e88c818a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8191 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114825.098547:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624570624:0@lo:501: 00000100:00100000:1.0:1787114825.098602:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114825.098638:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050faaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787114825.098672:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624570624 00000100:00100000:1.0:1787114825.098705:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624570624 00000100:00100000:1.0:1787114825.098743:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787114825.098751:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:5782:x1873925624570624:12345-0@lo:501: 00000100:00100000:1.0:1787114825.099250:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:5782:x1873925624570624:12345-0@lo:501: Request processed in 498us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114825.099258:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787114825.104284:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624570624:0@lo:501: 00000100:00100000:1.0:1787114825.104347:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624570752:0@lo:503: 00000100:00100000:1.0:1787114825.105309:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114825.105342:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050faaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787114825.105359:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624570752 00000100:00100000:1.0:1787114825.105365:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624570752 00000100:00100000:0.0:1787114825.106071:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624570880:0@lo:400: 00000100:00100000:0.0:1787114825.106123:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114825.106158:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787114825.106165:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624571008:0@lo:400: 00000100:00100000:0.0:1787114825.106191:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114825.106222:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624570880 00000100:00100000:0.0:1787114825.106226:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624570880 00000100:00100000:0.0:1787114825.106259:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624571008 00000100:00100000:0.0:1787114825.106262:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624571008 00000100:00100000:0.0:1787114825.106293:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787114825.106301:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624570880:12345-0@lo:400: 00000100:00100000:0.0:1787114825.106351:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624570880:12345-0@lo:400: Request processed in 50us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114825.106358:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787114825.106372:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787114825.106389:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624571008:12345-0@lo:400: 00000100:00100000:0.0:1787114825.106416:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624571008:12345-0@lo:400: Request processed in 38us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114825.106421:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787114825.106455:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af051363800 x1873925624571008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787114841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114825.106480:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624571008:0@lo:400: 00010000:00080000:0.0:1787114825.106493:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af051360000 x1873925624570880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787114841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114825.106500:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624570880:0@lo:400: 00000100:00080000:3.0:1787114825.109282:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787114825.109315:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787114825.109329:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:5782:x1873925624570752:12345-0@lo:503: 00000100:00100000:1.0:1787114825.109609:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:5782:x1873925624570752:12345-0@lo:503: Request processed in 284us (4300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114825.109617:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787114825.109709:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624570752:0@lo:503: 00000100:00100000:2.0:1787114825.109927:0:6827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:6827:1873925624571136:0@lo:502: 00000100:00100000:2.0:1787114825.109967:0:6827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114825.110000:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624571136 00000100:00100000:2.0:1787114825.110004:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624571136 00000100:00100000:2.0:1787114825.110028:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787114825.110035:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:6827:x1873925624571136:12345-0@lo:502: 00000100:00100000:2.0:1787114825.110364:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:6827:x1873925624571136:12345-0@lo:502: Request processed in 328us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114825.110371:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787114825.110416:0:6827:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042c68b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787114825.110618:0:6827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:6827:1873925624571136:0@lo:502: 00000100:00100000:2.0:1787114825.110672:0:6827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:6827:1873925624571264:0@lo:502: 00000100:00100000:2.0:1787114825.110703:0:6827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114825.110723:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624571264 00000100:00100000:2.0:1787114825.110727:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624571264 00000100:00100000:2.0:1787114825.110748:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787114825.110754:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:6827:x1873925624571264:12345-0@lo:502: 00000100:00100000:2.0:1787114825.110883:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:6827:x1873925624571264:12345-0@lo:502: Request processed in 129us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114825.110890:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787114825.110917:0:6827:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042c68b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787114825.110929:0:6827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:6827:1873925624571264:0@lo:502: 00000040:00080000:2.0:1787114825.110946:0:6827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787114825.110992:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787114825.111011:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787114825.111020:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041683800/0x194cd781e88c818a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8191 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114825.111031:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af041683800/0x194cd781e88c818a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8191 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787114825.111046:0:5782:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787114825.111049:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8af05032f000 from 4 10000000:01000000:2.0:1787114825.111052:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787114825.111076:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af08216f800/0x194cd781e88c8198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114825.111083:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af08216f800/0x194cd781e88c8198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114825.111093:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af08216f800/0x194cd781e88c8198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114825.111132:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624571392:0@lo:101: 00000100:00100000:2.0:1787114825.111225:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114825.111247:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042c68b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787114825.111259:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624571392 00000100:00100000:2.0:1787114825.111262:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624571392 00000100:00100000:2.0:1787114825.111281:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787114825.111287:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:5782:x1873925624571392:12345-0@lo:101: 00010000:00010000:2.0:1787114825.111295:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114825.111306:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af08216e200/0x194cd781e88c819f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8198 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114825.111327:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af08216e200/0x194cd781e88c819f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8198 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114825.111336:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af08216e200/0x194cd781e88c819f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8198 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114825.111356:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216e200, rc 0) 00000100:00100000:2.0:1787114825.111385:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:5782:x1873925624571392:12345-0@lo:101: Request processed in 98us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114825.111390:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787114825.111418:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624571392:0@lo:101: 00010000:00010000:2.0:1787114825.111546:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af08216f800/0x194cd781e88c8198 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c819f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114825.111556:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af08216f800/0x194cd781e88c8198 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c819f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114825.111598:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624571520:0@lo:256: 00000100:00100000:2.0:1787114825.111627:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114825.111642:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042c68b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787114825.111667:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624571520 00000100:00100000:2.0:1787114825.111670:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624571520 00000100:00100000:2.0:1787114825.111686:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787114825.111691:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:5782:x1873925624571520:12345-0@lo:256: 20000000:01000000:2.0:1787114825.111703:0:5778:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787114825.111718:0:5778:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787114825.111720:0:5778:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787114825.111792:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:5782:x1873925624571520:12345-0@lo:256: Request processed in 100us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114825.111798:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787114825.111825:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624571520:0@lo:256: 10000000:01000000:2.0:1787114825.111918:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787114825.111927:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af08216f800/0x194cd781e88c8198 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c819f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114825.111935:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af08216f800/0x194cd781e88c8198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c819f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787114825.111941:0:5782:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787114825.111943:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787114825.111945:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787114825.111958:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af08216e600/0x194cd781e88c81a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114825.111965:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af08216e600/0x194cd781e88c81a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114825.111973:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af08216e600/0x194cd781e88c81a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114825.111985:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624571648:0@lo:101: 00000100:00100000:2.0:1787114825.112007:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114825.112020:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042c68b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787114825.112031:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624571648 00000100:00100000:2.0:1787114825.112034:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624571648 00000100:00100000:2.0:1787114825.112050:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787114825.112055:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:5782:x1873925624571648:12345-0@lo:101: 00010000:00010000:2.0:1787114825.112061:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114825.112069:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af08216fa00/0x194cd781e88c81ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c81a6 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114825.112083:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af08216fa00/0x194cd781e88c81ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c81a6 expref: 15 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114825.112098:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af08216fa00/0x194cd781e88c81ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c81a6 expref: 15 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114825.112127:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216fa00, rc 0) 00000100:00100000:2.0:1787114825.112156:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:5782:x1873925624571648:12345-0@lo:101: Request processed in 101us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114825.112232:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787114825.112264:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624571648:0@lo:101: 00010000:00010000:2.0:1787114825.112275:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af08216e600/0x194cd781e88c81a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c81ad expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114825.112284:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af08216e600/0x194cd781e88c81a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c81ad expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114825.112324:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624571776:0@lo:501: 00000100:00100000:2.0:1787114825.112346:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114825.112358:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042c68b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787114825.112370:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624571776 00000100:00100000:2.0:1787114825.112373:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624571776 00000100:00100000:2.0:1787114825.112390:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787114825.112394:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:5782:x1873925624571776:12345-0@lo:501: 00000100:00100000:2.0:1787114825.112689:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:5782:x1873925624571776:12345-0@lo:501: Request processed in 294us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114825.112696:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787114825.112722:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624571776:0@lo:501: 00000100:00100000:2.0:1787114825.112746:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624571904:0@lo:503: 00000100:00100000:2.0:1787114825.112784:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114825.112798:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042c68b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787114825.112809:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624571904 00000100:00100000:2.0:1787114825.112811:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624571904 00000100:00100000:2.0:1787114825.112828:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787114825.112834:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:5782:x1873925624571904:12345-0@lo:503: 00000100:00100000:2.0:1787114825.113088:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:5782:x1873925624571904:12345-0@lo:503: Request processed in 253us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114825.113094:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787114825.113152:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624571904:0@lo:503: 00000100:00100000:3.0:1787114825.116417:0:6828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:6828:1873925624572032:0@lo:502: 00000100:00100000:3.0:1787114825.116542:0:6828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114825.116585:0:6828:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04d4f9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787114825.116636:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624572032 00000100:00100000:2.0:1787114825.116643:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624572032 00000100:00100000:2.0:1787114825.116745:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787114825.116755:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:6828:x1873925624572032:12345-0@lo:502: 00000100:00100000:2.0:1787114825.117192:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:6828:x1873925624572032:12345-0@lo:502: Request processed in 437us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114825.117201:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787114825.117336:0:6828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:6828:1873925624572032:0@lo:502: 00000020:01000000:3.0:1787114825.117364:0:6828:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787114825.117371:0:6828:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787114825.117378:0:6828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787114825.117380:0:6828:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787114825.117386:0:6828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787114825.117389:0:6828:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.110@tcp to nid 0x20000c0a8ca6e (192.168.202.110@tcp) 00000020:01000000:3.0:1787114825.117412:0:6828:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787114825.117415:0:6828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787114825.117490:0:6828:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8af0513019c0) 00000020:00000080:3.0:1787114825.117511:0:6828:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787114825.117519:0:6828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787114825.117583:0:6828:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787114825.117588:0:6828:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787114825.117595:0:6828:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x194cd781e88c81bb 00010000:00080000:3.0:1787114825.117621:0:6828:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8af07b224000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.110@tcp at head 00010000:00010000:2.0:1787114825.118915:0:6828:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787114825.208102:0:6828:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787114825.208260:0:6828:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787114825.208921:0:6828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787114825.209095:0:6828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787114825.209338:0:6828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787114825.209417:0:6828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787114825.210264:0:6835:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787114825.210270:0:6835:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787114825.210758:0:6828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787114825.210770:0:6828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787114825.210798:0:6828:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787114825.210815:0:6828:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x194cd781e88c81c2 00000100:00080000:0.0:1787114825.210824:0:6828:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787114825.210829:0:6828:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8af07b224000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1787114825.210872:0:6828:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af051360000 x1873925624572160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787114825.210895:0:6828:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787114825.210943:0:6828:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787114825.210947:0:6828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787114825.210949:0:6828:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787114825.210952:0:6828:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787114825.210956:0:6828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787114825.210958:0:6828:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787114825.210961:0:6828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787114825.210962:0:6828:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787114825.210982:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624572160:0@lo:8: 00000100:00100000:0.0:1787114825.210988:0:6828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051363800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:6828:1873925624572288:0@lo:502: 00000100:00100000:1.0:1787114825.211066:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114825.211075:0:6828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114825.211150:0:6828:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04d4dbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787114825.211193:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624572288 00000100:00100000:0.0:1787114825.211197:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624572288 00000100:00100000:0.0:1787114825.211235:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787114825.211251:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:6828:x1873925624572288:12345-0@lo:502: 00000100:00100000:0.0:1787114825.211546:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:6828:x1873925624572288:12345-0@lo:502: Request processed in 297us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114825.211554:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787114825.211602:0:6828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051363800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:6828:1873925624572288:0@lo:502: 00000020:01000000:0.0:1787114825.211624:0:6828:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787114825.211628:0:6828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787114825.211630:0:6828:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787114825.211632:0:6828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:2.0:1787114825.211905:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624572160 00000100:00100000:2.0:1787114825.211963:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624572160 00000100:00100000:2.0:1787114825.211989:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787114825.211995:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1873925624572160:12345-0@lo:8: 00010000:00080000:2.0:1787114825.212020:0:6576:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:2.0:1787114825.212043:0:6576:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x194cd781e88c81c9 00002000:00100000:2.0:1787114825.212134:0:6576:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8af077f15000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113803 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787114825.212139:0:6576:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1787114825.212143:0:6576:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787114825.212303:0:6576:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787114825.212554:0:6576:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787114825.212577:0:6576:0:(import.c:65:import_set_state_nolock()) ffff8af077f14000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787114825.212619:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1873925624572160:12345-0@lo:8: Request processed in 624us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114825.212625:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:2.0:1787114825.212646:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1787114825.212674:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787114825.212683:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af08216e600/0x194cd781e88c81a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c81ad expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114825.212694:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af08216e600/0x194cd781e88c81a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c81ad expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787114825.212702:0:5782:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787114825.212704:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8af05916cd40 from 1 10000000:01000000:2.0:1787114825.212706:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787114825.212729:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af08216f200/0x194cd781e88c81d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114825.212736:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af08216f200/0x194cd781e88c81d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114825.212744:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af08216f200/0x194cd781e88c81d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114825.212763:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624572416:0@lo:101: 00000100:00100000:2.0:1787114825.212791:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114825.212855:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042c683c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787114825.220648:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624572416 00000100:00100000:0.0:1787114825.220672:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624572416 00000100:00100000:0.0:1787114825.220722:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787114825.220731:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:5782:x1873925624572416:12345-0@lo:101: 00010000:00010000:0.0:1787114825.220748:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114825.220765:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af052364200/0x194cd781e88c81d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c81d0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114825.220856:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af052364200/0x194cd781e88c81d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c81d0 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114825.220867:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af052364200/0x194cd781e88c81d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c81d0 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114825.220876:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052364200, rc 0) 00000100:00100000:0.0:1787114825.221128:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:5782:x1873925624572416:12345-0@lo:101: Request processed in 397us (8334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114825.221135:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1787114825.223395:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af051360000 x1873925624572160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787114835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114825.223409:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787114825.223418:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787114825.223425:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787114825.223430:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787114825.223434:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af07b224000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787114825.223467:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787114825.223474:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624572160:0@lo:8: 00000004:00080000:1.0:1787114825.223513:0:6835:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787114825.223663:0:6835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 154209554500ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787114825.223889:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624572416:0@lo:101: 00010000:00010000:2.0:1787114825.223910:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af08216f200/0x194cd781e88c81d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c81d7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114825.223921:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af08216f200/0x194cd781e88c81d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c81d7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114825.223980:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624572544:0@lo:501: 00000100:00100000:2.0:1787114825.224028:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114825.224050:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042c683c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787114825.224899:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624572544 00000100:00100000:2.0:1787114825.224907:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624572544 00000100:00100000:2.0:1787114825.224954:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787114825.224963:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:5782:x1873925624572544:12345-0@lo:501: 00000100:00100000:2.0:1787114825.225679:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:5782:x1873925624572544:12345-0@lo:501: Request processed in 715us (1648us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787114825.225688:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787114825.225840:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624572544:0@lo:501: 10000000:01000000:1.0:1787114825.225869:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787114825.225875:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af08216f200/0x194cd781e88c81d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c81d7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114825.225882:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af08216f200/0x194cd781e88c81d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c81d7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787114825.324981:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787114825.394610:0:6836:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787114825.394644:0:6836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6836:1873925624572800:0@lo:7: 00000100:00100000:1.0:1787114825.394721:0:6836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114825.394783:0:6836:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050faa6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787114825.394829:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624572672:0@lo:13: 00000100:00100000:2.0:1787114825.395299:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624572800 00000100:00100000:2.0:1787114825.395308:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624572800 00000100:00100000:2.0:1787114825.395361:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787114825.395371:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6836:x1873925624572800:12345-0@lo:7: 00000100:00100000:1.0:1787114825.395965:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114825.396026:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624572672 00000100:00100000:1.0:1787114825.396031:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624572672 00000100:00100000:1.0:1787114825.396077:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787114825.396085:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1873925624572672:12345-0@lo:13: 00002000:00000024:1.0:1787114825.396129:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00080000:3.0:1787114825.396190:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787114825.397327:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1873925624572672:12345-0@lo:13: Request processed in 1239us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114825.397339:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787114825.397393:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af042cba680 x1873925624572672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114825.397414:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624572672:0@lo:13: 00002000:00080000:0.0:1787114825.405941:0:6578:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787114825.405955:0:6578:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00010000:00080000:1.0:1787114825.406186:0:6836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af042cb9500 x1873925624572800/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787114841 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114825.406204:0:6836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6836:1873925624572800:0@lo:7: 00000004:00080000:1.0:1787114825.406220:0:6836:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787114825.406263:0:6836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6836:1873925624572928:0@lo:5: 00000100:00100000:1.0:1787114825.406303:0:6836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114825.406320:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6836:x1873925624572800:12345-0@lo:7: Request processed in 10947us (11596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114825.406334:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787114825.406355:0:6836:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050faa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787114825.406366:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624572928 00000100:00100000:0.0:1787114825.406373:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624572928 00000100:00100000:0.0:1787114825.406509:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787114825.406518:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6836:x1873925624572928:12345-0@lo:5: 00002000:00080000:0.0:1787114825.406547:0:6578:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787114825.406552:0:6578:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787114825.406827:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6836:x1873925624572928:12345-0@lo:5: Request processed in 299us (513us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787114825.406841:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787114825.407004:0:6836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af042cb9500 x1873925624572928/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787114841 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114825.407019:0:6836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6836:1873925624572928:0@lo:5: 00000004:00080000:1.0:1787114825.407028:0:6836:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787114825.407059:0:6836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6836:1873925624573056:0@lo:700: 00000100:00100000:1.0:1787114825.407095:0:6836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114825.407132:0:6836:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050faa6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787114825.407171:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624573056 00000100:00100000:1.0:1787114825.407175:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624573056 00000100:00100000:1.0:1787114825.407201:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787114825.407208:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6836:x1873925624573056:12345-0@lo:700: 00000100:00100000:1.0:1787114825.407236:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cba300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6585:1873925624573184:0@lo:700: 00000100:00100000:1.0:1787114825.407261:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114825.407277:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050faa0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787114825.407297:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624573184 00000100:00100000:1.0:1787114825.407300:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624573184 00000100:00100000:1.0:1787114825.407323:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787114825.407329:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6585:x1873925624573184:12345-0@lo:700: 40000000:02000000:1.0:1787114825.454888:0:5792:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1787114825.465430:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6585:x1873925624573184:12345-0@lo:700: Request processed in 58091us (58157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114825.465446:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787114825.468969:0:6585:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af042cba300 x1873925624573184/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787114841 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114825.468991:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cba300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6585:1873925624573184:0@lo:700: 40000000:02000000:0.0:1787114825.469009:0:6585:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1787114825.547338:0:6604:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1787114825.547366:0:6604:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787114825.547414:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:6836:x1873925624573056:12345-0@lo:700: Request processed in 140201us (140313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114825.547427:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787114825.547494:0:6836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af042cb9c00 x1873925624573056/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787114841 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114825.547511:0:6836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6836:1873925624573056:0@lo:700: 00000004:02000040:1.0:1787114825.594833:0:6836:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1787114825.605275:0:6836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051363800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6836:1873925624573312:0@lo:5: 00000100:00100000:0.0:1787114825.605347:0:6836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114825.605403:0:6836:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04d4dba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787114825.605570:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624573312 00000100:00100000:3.0:1787114825.605578:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624573312 00000100:00100000:3.0:1787114825.605632:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787114825.605641:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6836:x1873925624573312:12345-0@lo:5: 00002000:00080000:3.0:1787114825.612734:0:6576:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787114825.612754:0:6576:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1787114825.633308:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6836:x1873925624573312:12345-0@lo:5: Request processed in 27660us (27952us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787114825.633322:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787114825.633472:0:6836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af051363800 x1873925624573312/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787114841 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114825.633486:0:6836:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787114825.633500:0:6836:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8af051363800 x1873925624573312/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787114841 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114825.633512:0:6836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051363800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6836:1873925624573312:0@lo:5: 00000004:00080000:0.0:1787114825.633525:0:6836:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1787114825.933523:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114826.950021:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787114827.845750:0:6950:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg210-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787114827.978572:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114828.999232:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114830.030202:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114830.213479:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624573440:0@lo:400: 00000100:00100000:1.0:1787114830.213556:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114830.213637:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787114830.213644:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624573824:0@lo:400: 00000100:00100000:1.0:1787114830.213674:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114830.213722:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624573824 00000100:00100000:1.0:1787114830.213731:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624573824 00000100:00100000:1.0:1787114830.213816:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787114830.213825:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1873925624573824:12345-0@lo:400: 00000100:00100000:1.0:1787114830.213874:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1873925624573824:12345-0@lo:400: Request processed in 51us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114830.213882:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787114830.213903:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787114830.213935:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af05125f480 x1873925624573824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114830.213950:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624573824:0@lo:400: 00000100:00100000:0.0:1787114830.214081:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624573568:0@lo:400: 00000100:00100000:0.0:1787114830.214145:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114830.214168:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787114830.214175:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624573696:0@lo:400: 00000100:00100000:0.0:1787114830.214197:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114830.214227:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624573568 00000100:00100000:0.0:1787114830.214231:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624573568 00000100:00100000:0.0:1787114830.214255:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624573696 00000100:00100000:0.0:1787114830.214257:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624573696 00000100:00100000:0.0:1787114830.214273:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787114830.214278:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624573568:12345-0@lo:400: 00000100:00100000:0.0:1787114830.214313:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624573568:12345-0@lo:400: Request processed in 34us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114830.214319:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787114830.214332:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787114830.214338:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624573696:12345-0@lo:400: 00000100:00100000:0.0:1787114830.214365:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624573696:12345-0@lo:400: Request processed in 28us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114830.214371:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787114830.214400:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af05125d180 x1873925624573696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787114846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114830.214409:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624573696:0@lo:400: 00010000:00080000:0.0:1787114830.214420:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af05125e300 x1873925624573568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787114846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114830.214449:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624573568:0@lo:400: 00000100:00080000:1.0:1787114830.214646:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787114830.214701:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624573440 00000100:00100000:2.0:1787114830.214706:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624573440 00000100:00100000:2.0:1787114830.214744:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787114830.214751:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:3309:x1873925624573440:12345-0@lo:400: 00000100:00100000:2.0:1787114830.214811:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:3309:x1873925624573440:12345-0@lo:400: Request processed in 60us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114830.214817:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787114830.215009:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624573440:0@lo:400: 00000100:00100000:3.0:1787114830.725661:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787114830.725690:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051360a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624573952:0@lo:13: 00000100:00100000:3.0:1787114830.725781:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114830.726405:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624573952 00000100:00100000:1.0:1787114830.726414:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624573952 00000100:00100000:1.0:1787114830.726472:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787114830.726483:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1873925624573952:12345-0@lo:13: 00002000:00000024:1.0:1787114830.726520:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787114830.726578:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1873925624573952:12345-0@lo:13: Request processed in 97us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114830.726586:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787114830.726801:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af051360a80 x1873925624573952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114830.726821:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051360a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624573952:0@lo:13: 00000001:00080000:0.0:1787114830.905322:0:6604:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1787114831.045368:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114832.076897:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114833.095249:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114834.117270:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114835.141463:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114835.333688:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624574080:0@lo:400: 00000100:00100000:2.0:1787114835.333767:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114835.333846:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787114835.333853:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624574208:0@lo:400: 00000100:00100000:2.0:1787114835.333880:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114835.333914:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051360a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624574464:0@lo:400: 00000100:00100000:2.0:1787114835.333943:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114835.333966:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787114835.333971:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051360e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624574336:0@lo:400: 00000100:00100000:2.0:1787114835.333997:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114835.334030:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624574208 00000100:00100000:2.0:1787114835.334038:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624574208 00000100:00100000:2.0:1787114835.334084:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624574336 00000100:00100000:2.0:1787114835.334087:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624574336 00000100:00100000:2.0:1787114835.334138:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787114835.334244:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787114835.334254:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787114835.334273:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624574464 00000100:00100000:3.0:1787114835.334277:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624574464 00000100:00100000:3.0:1787114835.334310:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787114835.334320:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624574464:12345-0@lo:400: 00000100:00100000:3.0:1787114835.334376:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624574464:12345-0@lo:400: Request processed in 59us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114835.334384:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787114835.334405:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624574080 00000100:00100000:0.0:1787114835.334411:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624574080 00000100:00100000:0.0:1787114835.334444:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787114835.334453:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:3306:x1873925624574080:12345-0@lo:400: 00000100:00100000:0.0:1787114835.334504:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:3306:x1873925624574080:12345-0@lo:400: Request processed in 52us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114835.334513:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1787114835.334530:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af051360a80 x1873925624574464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114835.334542:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787114835.334571:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051360a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624574464:0@lo:400: 00000100:00080000:0.0:1787114835.334573:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787114835.334580:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787114835.334594:0:5785:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787114835.334605:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787114835.334614:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624574336:12345-0@lo:400: 00000100:00100000:0.0:1787114835.334657:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624574336:12345-0@lo:400: Request processed in 45us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114835.334663:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787114835.334692:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af051360e00 x1873925624574336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787114851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114835.334703:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051360e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624574336:0@lo:400: 00000100:00100000:3.0:1787114835.334776:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624574080:0@lo:400: 00000100:00100000:2.0:1787114835.334852:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624574208:12345-0@lo:400: 00000100:00100000:2.0:1787114835.334904:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624574208:12345-0@lo:400: Request processed in 743us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114835.334911:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787114835.335280:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af051362a00 x1873925624574208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787114851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114835.335290:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624574208:0@lo:400: 00000100:00100000:0.0:1787114835.847901:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787114835.847931:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051360e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624574592:0@lo:13: 00000100:00100000:0.0:1787114835.848004:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114835.848093:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624574592 00000100:00100000:0.0:1787114835.848103:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624574592 00000100:00100000:0.0:1787114835.848174:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787114835.848183:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624574592:12345-0@lo:13: 00002000:00000024:0.0:1787114835.848218:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787114835.848266:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624574592:12345-0@lo:13: Request processed in 83us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114835.848273:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787114835.848317:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af051360e00 x1873925624574592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114835.849433:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051360e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624574592:0@lo:13: 00010000:00010000:0.0:1787114836.169750:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787114837.189722:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114838.217008:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787114839.237217:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787114839.417669:0:7467:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787114839.417674:0:7467:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787114839.417870:0:7467:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8af07b581000 00000020:01000004:1.0:1787114839.417886:0:7467:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787114839.417899:0:7467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787114839.417921:0:7467:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8af07fb20000) 00000020:00000080:1.0:1787114839.417939:0:7467:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787114839.433427:0:7467:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787114839.433894:0:7467:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787114839.454829:0:7467:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787114839.460583:0:7467:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787114839.460615:0:7467:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787114839.460667:0:7467:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787114839.460762:0:7467:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787114839.461139:0:7467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787114839.461232:0:7467:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787114839.461245:0:7467:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x194cd781e88c81e5 00000020:01000004:3.0:1787114839.461254:0:7467:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787114839.461276:0:7467:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.110@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787114839.461279:0:7467:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787114839.461285:0:7467:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787114839.461379:0:7467:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787114839.461385:0:7467:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.110@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787114839.479949:0:7467:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.110@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787114839.479987:0:7467:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.110@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787114839.479991:0:7467:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787114839.479993:0:7467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787114839.479994:0:7467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787114839.479995:0:7467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787114839.479996:0:7467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787114839.479997:0:7467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787114839.479999:0:7467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787114839.480000:0:7467:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787114839.480002:0:7467:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787114839.480003:0:7467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787114839.480005:0:7467:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787114839.480009:0:7467:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787114839.480011:0:7467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787114839.480012:0:7467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787114839.480013:0:7467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787114839.480014:0:7467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787114839.480015:0:7467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787114839.480020:0:7467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787114839.480021:0:7467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787114839.480022:0:7467:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787114839.480023:0:7467:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787114839.480024:0:7467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787114839.480025:0:7467:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787114839.480049:0:7467:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787114839.480070:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624574720:0@lo:253: 00000100:00100000:3.0:1787114839.480600:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114839.480768:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624574720 00000100:00100000:2.0:1787114839.480776:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624574720 00000100:00100000:2.0:1787114839.480822:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787114839.480831:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:7467:x1873925624574720:12345-0@lo:253: 20000000:01000000:2.0:1787114839.480864:0:5778:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787114839.480868:0:5778:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1787114839.480874:0:5778:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1787114839.480878:0:5778:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000100:00100000:3.0:1787114839.481398:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050797b40 going to sleep for 11 seconds 00000040:00080000:2.0:1787114839.482160:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787114839.482610:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1787114839.482625:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1787114839.482668:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1787114839.482677:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1787114839.482788:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1787114839.482843:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1787114839.483595:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1787114839.483619:0:5778:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.110@tcp 20000000:01000000:2.0:1787114839.483622:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.110@tcp (null) (null) (null) 00000040:00080000:2.0:1787114839.483662:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1787114839.483671:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787114839.483799:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1787114839.483808:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.110@tcp (null) (null) 00000040:00080000:2.0:1787114839.483840:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1787114839.483857:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787114839.483891:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1787114839.483943:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1787114839.485284:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1787114839.485384:0:5778:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.110@tcp 20000000:01000000:2.0:1787114839.485387:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.110@tcp (null) (null) (null) 00000040:00080000:2.0:1787114839.485434:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1787114839.485443:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787114839.485473:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1787114839.485480:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.110@tcp (null) (null) 00000040:00080000:2.0:1787114839.485509:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1787114839.485528:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787114839.485591:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1787114839.485635:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1787114839.485651:0:5778:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787114839.485655:0:5778:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787114839.485658:0:5778:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787114839.485671:0:5778:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787114839.485673:0:5778:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787114839.485776:0:5778:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787114839.485779:0:5778:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787114839.486588:0:7469:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787114839.486635:0:7469:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787114839.486679:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787114839.487048:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787114839.487091:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787114839.487432:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787114839.487447:0:5778:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787114839.487449:0:5778:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787114839.488096:0:7470:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1787114839.488426:0:7470:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1787114839.488464:0:7470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1787114839.488816:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1787114839.488878:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1787114839.488935:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1787114839.488950:0:5778:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787114839.488953:0:5778:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787114839.489627:0:7471:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1787114839.489677:0:7471:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1787114839.489803:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787114839.490041:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787114839.490080:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787114839.490396:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787114839.490410:0:5778:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787114839.490412:0:5778:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787114839.490870:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787114839.491097:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787114839.491448:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787114839.491538:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787114839.491557:0:5778:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1787114839.491559:0:5778:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1787114839.491569:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787114839.491589:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8af0429cb400/0x194cd781e88c81ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114839.491606:0:5778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af0429cbc00/0x194cd781e88c813d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8136 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114839.491620:0:5778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af0429ca800/0x194cd781e88c8167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8160 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114839.491627:0:5778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af041683e00/0x194cd781e88c8191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c818a expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114839.491634:0:5778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af08216fa00/0x194cd781e88c81ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c81a6 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114839.491640:0:5778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af052364200/0x194cd781e88c81d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c81d0 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114839.491647:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8af0429cb400/0x194cd781e88c81ec lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114839.491748:0:5778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af052364200/0x194cd781e88c81d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c81d0 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114839.491762:0:5778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af052364200/0x194cd781e88c81d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c81d0 expref: 16 pid: 5779 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114839.491776:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5778:1873925624574848:0@lo:104: 00000100:00100000:3.0:1787114839.491845:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787114839.491929:0:5778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af08216fa00/0x194cd781e88c81ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c81a6 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114839.491937:0:5778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af08216fa00/0x194cd781e88c81ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c81a6 expref: 16 pid: 5778 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114839.491945:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5778:1873925624574976:0@lo:104: 00010000:00010000:3.0:1787114839.491972:0:5778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af041683e00/0x194cd781e88c8191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c818a expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114839.491980:0:5778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af041683e00/0x194cd781e88c8191 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c818a expref: 16 pid: 5780 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114839.491987:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5778:1873925624575104:0@lo:104: 00010000:00010000:3.0:1787114839.492003:0:5778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af0429ca800/0x194cd781e88c8167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c8160 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114839.492009:0:5778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af0429ca800/0x194cd781e88c8167 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c8160 expref: 16 pid: 5779 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114839.492016:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5778:1873925624575232:0@lo:104: 00010000:00010000:3.0:1787114839.492032:0:5778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af0429cbc00/0x194cd781e88c813d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c8136 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114839.492039:0:5778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af0429cbc00/0x194cd781e88c813d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c8136 expref: 16 pid: 5779 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114839.492046:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5778:1873925624575360:0@lo:104: 00000100:00100000:3.0:1787114839.492059:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050797d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787114839.492358:0:5769:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787114839.492379:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114839.492435:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114839.492485:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114839.492503:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624574848 00000100:00100000:2.0:1787114839.492510:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624574848 00000100:00100000:2.0:1787114839.492555:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624574976 00000100:00100000:2.0:1787114839.492559:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624574976 00000100:00100000:2.0:1787114839.492570:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624575104 00000100:00100000:2.0:1787114839.492572:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624575104 00000100:00100000:2.0:1787114839.492583:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787114839.492591:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0431a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+5:5778:x1873925624574848:12345-0@lo:104: 00010000:00010000:2.0:1787114839.492613:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af08216f200/0x194cd781e88c81d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c81d7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.492773:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787114839.492780:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0431a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+5:5778:x1873925624574848:12345-0@lo:104: Request processed in 190us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114839.492787:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787114839.492825:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787114839.492831:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051360e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+4:5778:x1873925624574976:12345-0@lo:104: 00010000:00010000:2.0:1787114839.492839:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af08216e600/0x194cd781e88c81a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c81ad expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.492873:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787114839.492878:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051360e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+4:5778:x1873925624574976:12345-0@lo:104: Request processed in 48us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114839.492884:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787114839.492896:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787114839.492902:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051363100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:5778:x1873925624575104:12345-0@lo:104: 00010000:00010000:2.0:1787114839.492909:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af041683800/0x194cd781e88c818a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8191 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.492933:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787114839.492937:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051363100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:5778:x1873925624575104:12345-0@lo:104: Request processed in 37us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114839.492942:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787114839.492959:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787114839.492965:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af08216f200/0x194cd781e88c81d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c81d7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.492980:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216f200 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1787114839.492984:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af08216f200/0x194cd781e88c81d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c81d7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.492991:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af08216f200/0x194cd781e88c81d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c81d7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787114839.492998:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af08216f200/0x194cd781e88c81d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c81d7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787114839.493003:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787114839.493033:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af08216f200/0x194cd781e88c81d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c81d7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493040:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787114839.493060:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af08216f200/0x194cd781e88c81d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c81d7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493068:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af08216f200/0x194cd781e88c81d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c81d7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493083:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787114839.493085:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af08216e600/0x194cd781e88c81a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c81ad expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493091:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e600 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1787114839.493094:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af08216e600/0x194cd781e88c81a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c81ad expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493139:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af08216e600/0x194cd781e88c81a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c81ad expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787114839.493146:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af08216e600/0x194cd781e88c81a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c81ad expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787114839.493220:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787114839.493238:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af08216e600/0x194cd781e88c81a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c81ad expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493243:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787114839.493258:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af08216e600/0x194cd781e88c81a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c81ad expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493265:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af08216e600/0x194cd781e88c81a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c81ad expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493276:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787114839.493279:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af041683800/0x194cd781e88c818a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8191 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493284:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041683800 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1787114839.493286:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af041683800/0x194cd781e88c818a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c8191 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114839.493402:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114839.493412:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624575232 00000100:00100000:0.0:1787114839.493416:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624575232 00000100:00100000:0.0:1787114839.493436:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624575360 00000100:00100000:0.0:1787114839.493438:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624575360 00000100:00100000:0.0:1787114839.493447:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787114839.493452:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051362a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+4:5778:x1873925624575232:12345-0@lo:104: 00010000:00010000:0.0:1787114839.493466:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c8160 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8167 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114839.493500:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787114839.493505:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051362a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+4:5778:x1873925624575232:12345-0@lo:104: Request processed in 54us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114839.493511:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787114839.493539:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787114839.493546:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051362680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:5778:x1873925624575360:12345-0@lo:104: 00010000:00010000:0.0:1787114839.493553:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c8136 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c813d expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114839.493579:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787114839.493584:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051362680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:5778:x1873925624575360:12345-0@lo:104: Request processed in 40us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114839.493590:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787114839.493632:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af041683800/0x194cd781e88c818a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c8191 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787114839.493642:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af041683800/0x194cd781e88c818a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c8191 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787114839.493653:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787114839.493669:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af041683800/0x194cd781e88c818a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8191 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493674:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787114839.493680:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af041683800/0x194cd781e88c818a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8191 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493755:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af041683800/0x194cd781e88c818a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8191 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493765:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787114839.493768:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c8160 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8167 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493774:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429ca200 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1787114839.493777:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c8160 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c8167 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493784:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c8160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c8167 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787114839.493789:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c8160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c8167 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787114839.493795:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787114839.493807:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c8160 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8167 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493813:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787114839.493825:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c8160 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8167 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493832:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c8160 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8167 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493844:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787114839.493847:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c8136 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c813d expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493853:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052365c00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1787114839.493855:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c8136 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c813d expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493861:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c8136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c813d expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787114839.493867:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c8136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c813d expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787114839.493872:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787114839.493886:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c8136 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c813d expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493892:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787114839.493896:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c8136 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c813d expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493902:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c8136 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c813d expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.493916:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114839.493926:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114839.493928:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114839.493952:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624575488:0@lo:103: 00000100:00100000:2.0:1787114839.493989:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787114839.494071:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114839.494163:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624576000:0@lo:103: 00000100:00100000:2.0:1787114839.494185:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114839.494342:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5778:1873925624574848:0@lo:104: 00000100:00100000:3.0:1787114839.494355:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5778:1873925624574976:0@lo:104: 00000100:00100000:3.0:1787114839.494364:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5778:1873925624575104:0@lo:104: 00000100:00100000:3.0:1787114839.494371:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5778:1873925624575232:0@lo:104: 00000100:00100000:3.0:1787114839.494379:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5778:1873925624575360:0@lo:104: 00010000:00010000:3.0:1787114839.494413:0:5778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8af0429cb400/0x194cd781e88c81ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114839.494630:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787114839.494637:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624575872:0@lo:103: 00000100:00100000:2.0:1787114839.494659:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114839.494677:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624575488 00000100:00100000:0.0:1787114839.494690:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624575488 00010000:00010000:0.0:1787114839.494713:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af052364200/0x194cd781e88c81d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c81d0 expref: 17 pid: 5779 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114839.494753:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624576000 00000100:00100000:1.0:1787114839.494757:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624576000 00010000:00010000:1.0:1787114839.494774:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af0429cbc00/0x194cd781e88c813d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8136 expref: 18 pid: 5779 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114839.494804:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787114839.494812:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:3307:x1873925624575488:12345-0@lo:103: 00010000:00010000:1.0:1787114839.494823:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787114839.494829:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af052364200/0x194cd781e88c81d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c81d0 expref: 18 pid: 5779 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.494840:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af052364200/0x194cd781e88c81d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c81d0 expref: 18 pid: 5779 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.494856:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af052364200/0x194cd781e88c81d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c81d0 expref: 18 pid: 5779 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.494870:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787114839.494895:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:3307:x1873925624575488:12345-0@lo:103: Request processed in 84us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114839.494901:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787114839.494914:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787114839.494924:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:3307:x1873925624576000:12345-0@lo:103: 00010000:00010000:1.0:1787114839.494931:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787114839.494935:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af0429cbc00/0x194cd781e88c813d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8136 expref: 16 pid: 5779 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.494942:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af0429cbc00/0x194cd781e88c813d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c8136 expref: 16 pid: 5779 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.494950:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af0429cbc00/0x194cd781e88c813d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c8136 expref: 16 pid: 5779 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.494958:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787114839.494976:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:3307:x1873925624576000:12345-0@lo:103: Request processed in 53us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114839.494981:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787114839.495228:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624575872 00000100:00100000:1.0:1787114839.495232:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624575872 00010000:00010000:1.0:1787114839.495246:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af0429ca800/0x194cd781e88c8167 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8160 expref: 15 pid: 5779 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114839.495347:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624575488:0@lo:103: 00000100:00100000:2.0:1787114839.495356:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624576000:0@lo:103: 00000100:00100000:2.0:1787114839.495383:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624575616:0@lo:103: 00000100:00100000:2.0:1787114839.495406:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114839.495512:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787114839.495528:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624575744:0@lo:103: 00000100:00100000:2.0:1787114839.495547:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114839.495621:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624575616 00000100:00100000:1.0:1787114839.495625:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624575616 00010000:00010000:1.0:1787114839.495637:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af08216fa00/0x194cd781e88c81ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c81a6 expref: 16 pid: 5778 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114839.495649:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787114839.495654:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:3307:x1873925624575872:12345-0@lo:103: 00010000:00010000:1.0:1787114839.495663:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787114839.495666:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af0429ca800/0x194cd781e88c8167 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8160 expref: 16 pid: 5779 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.495696:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af0429ca800/0x194cd781e88c8167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c8160 expref: 16 pid: 5779 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.495705:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af0429ca800/0x194cd781e88c8167 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c8160 expref: 16 pid: 5779 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.495716:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787114839.495742:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:3307:x1873925624575872:12345-0@lo:103: Request processed in 87us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114839.495748:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787114839.495760:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787114839.495765:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:3308:x1873925624575616:12345-0@lo:103: 00010000:00010000:1.0:1787114839.495773:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787114839.495777:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af08216fa00/0x194cd781e88c81ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c81a6 expref: 14 pid: 5778 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.495784:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af08216fa00/0x194cd781e88c81ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c81a6 expref: 14 pid: 5778 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.495793:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af08216fa00/0x194cd781e88c81ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c81a6 expref: 14 pid: 5778 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.495803:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787114839.495821:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:3308:x1873925624575616:12345-0@lo:103: Request processed in 56us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114839.495826:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787114839.495851:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624575872:0@lo:103: 00000100:00100000:2.0:1787114839.495986:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624575616:0@lo:103: 00000100:00100000:1.0:1787114839.496240:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624575744 00000100:00100000:1.0:1787114839.496250:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624575744 00010000:00010000:1.0:1787114839.496264:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af041683e00/0x194cd781e88c8191 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c818a expref: 13 pid: 5780 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114839.496278:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787114839.496284:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:3308:x1873925624575744:12345-0@lo:103: 00010000:00010000:1.0:1787114839.496291:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787114839.496305:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af041683e00/0x194cd781e88c8191 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c818a expref: 13 pid: 5780 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.496313:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af041683e00/0x194cd781e88c8191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c818a expref: 13 pid: 5780 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.496323:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af041683e00/0x194cd781e88c8191 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c818a expref: 13 pid: 5780 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.496336:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8af0429cb400/0x194cd781e88c81ec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.496345:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af0429cb400/0x194cd781e88c81ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.496359:0:5770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af0429cb400/0x194cd781e88c81ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.496366:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af0429cb400/0x194cd781e88c81ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.496375:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8af0429cb400/0x194cd781e88c81ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.496380:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8af0429cb400/0x194cd781e88c81ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.496393:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cb400 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:1.0:1787114839.496397:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8af0429cb400/0x194cd781e88c81ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.496404:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8af0429cb400/0x194cd781e88c81ec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.496418:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8af0429cb400/0x194cd781e88c81ec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.496427:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787114839.496455:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:3308:x1873925624575744:12345-0@lo:103: Request processed in 172us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114839.496461:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787114839.496487:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624575744:0@lo:103: 00010000:00010000:0.0:1787114839.497173:0:5778:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8af0429cb400/0x194cd781e88c81ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114839.497186:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8af0429cb400/0x194cd781e88c81ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114839.497192:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af0429cb400/0x194cd781e88c81ec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787114839.497218:0:5778:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787114839.546210:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:7467:x1873925624574720:12345-0@lo:253: Request processed in 65371us (65603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114839.546224:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787114839.546455:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624574720:0@lo:253: 10000000:01000000:1.0:1787114839.546470:0:7467:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787114839.546474:0:7467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787114839.546476:0:7467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787114839.546478:0:7467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787114839.546479:0:7467:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787114839.546480:0:7467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787114839.546482:0:7467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787114839.546483:0:7467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787114839.546485:0:7467:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787114839.546487:0:7467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787114839.546488:0:7467:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787114839.546508:0:7467:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8af07b581000 from lustre-OST0001 10000000:01000000:1.0:1787114839.546549:0:7467:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787114839.546552:0:7467:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787114839.546578:0:7467:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8af05916cd40 local copy 10000000:01000000:1.0:1787114839.546581:0:7467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787114839.546619:0:7467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041683e00/0x194cd781e88c81f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.546630:0:7467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.110@tcp lock: ffff8af041683e00/0x194cd781e88c81f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.546640:0:7467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af041683e00/0x194cd781e88c81f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114839.546657:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624576128:0@lo:101: 00000100:00100000:1.0:1787114839.546699:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114839.546750:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045a373c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787114839.546819:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624576128 00000100:00100000:0.0:1787114839.546826:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624576128 00000100:00100000:0.0:1787114839.546872:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787114839.546881:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+11:7467:x1873925624576128:12345-0@lo:101: 00010000:00010000:0.0:1787114839.546894:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114839.546909:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af052365e00/0x194cd781e88c81fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c81f3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114839.546932:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af052365e00/0x194cd781e88c81fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c81f3 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114839.546943:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af052365e00/0x194cd781e88c81fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c81f3 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114839.546952:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052365e00, rc 0) 00000100:00100000:0.0:1787114839.546997:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:7467:x1873925624576128:12345-0@lo:101: Request processed in 117us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114839.547004:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787114839.547164:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624576128:0@lo:101: 00010000:00010000:2.0:1787114839.547179:0:7467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af041683e00/0x194cd781e88c81f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x194cd781e88c81fa expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.547187:0:7467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af041683e00/0x194cd781e88c81f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x194cd781e88c81fa expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114839.547282:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624576256:0@lo:501: 00000100:00100000:2.0:1787114839.547447:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114839.547466:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06e927240 going to sleep for 11 seconds 00000100:00100000:0.0:1787114839.547589:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624576256 00000100:00100000:0.0:1787114839.547594:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624576256 00000100:00100000:0.0:1787114839.547625:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787114839.547632:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:7467:x1873925624576256:12345-0@lo:501: 00000100:00100000:0.0:1787114839.547900:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:7467:x1873925624576256:12345-0@lo:501: Request processed in 267us (451us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787114839.547913:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787114839.548256:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624576256:0@lo:501: 10000000:01000000:0.0:1787114839.548416:0:7467:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787114839.548453:0:7467:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787114839.548460:0:7467:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041683e00/0x194cd781e88c81f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x194cd781e88c81fa expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114839.548469:0:7467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041683e00/0x194cd781e88c81f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x194cd781e88c81fa expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114839.548476:0:7467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff8af041683e00/0x194cd781e88c81f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x194cd781e88c81fa expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114839.548545:0:7467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787114839.548570:0:7467:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8af07b581000 10000000:01000000:0.0:1787114839.548576:0:7467:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787114839.548582:0:7467:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787114839.548584:0:7467:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787114839.548587:0:7467:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787114839.548590:0:7467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787114839.548613:0:7467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c8201 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114839.548621:0:7467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c8201 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114839.548629:0:7467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c8201 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114839.548644:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051360a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624576384:0@lo:101: 00000100:00100000:0.0:1787114839.548744:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114839.548812:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04d4db300 going to sleep for 11 seconds 00010000:00010000:2.0:1787114839.548854:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787114839.548861:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af041683e00/0x194cd781e88c81f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x194cd781e88c81fa expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.548869:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041683e00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1787114839.548873:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af041683e00/0x194cd781e88c81f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x194cd781e88c81fa expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.548881:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af041683e00/0x194cd781e88c81f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x194cd781e88c81fa expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787114839.548888:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af041683e00/0x194cd781e88c81f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x194cd781e88c81fa expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787114839.548894:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787114839.548913:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af041683e00/0x194cd781e88c81f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x194cd781e88c81fa expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.548919:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787114839.548972:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1787114839.548990:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af041683e00/0x194cd781e88c81f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x194cd781e88c81fa expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.548998:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af041683e00/0x194cd781e88c81f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x194cd781e88c81fa expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.549013:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114839.549015:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114839.549018:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114839.549093:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624576384 00000100:00100000:1.0:1787114839.549099:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624576384 00000100:00100000:1.0:1787114839.549474:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787114839.549484:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:7467:x1873925624576384:12345-0@lo:101: 00010000:00010000:1.0:1787114839.549495:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787114839.549509:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af041682600/0x194cd781e88c8208 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8201 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.549539:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af041682600/0x194cd781e88c8208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8201 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.549550:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af041682600/0x194cd781e88c8208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8201 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.549559:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041682600, rc 0) 00000100:00100000:1.0:1787114839.549611:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:7467:x1873925624576384:12345-0@lo:101: Request processed in 129us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114839.549618:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787114839.549774:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624576512:0@lo:103: 00000100:00100000:0.0:1787114839.549805:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114839.549897:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051360a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624576384:0@lo:101: 00010000:00010000:0.0:1787114839.549911:0:7467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c8201 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8208 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114839.549920:0:7467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c8201 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8208 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114839.550018:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051360a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624576640:0@lo:501: 00000100:00100000:0.0:1787114839.550043:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114839.550068:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04d4db300 going to sleep for 11 seconds 00000100:00100000:2.0:1787114839.550364:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624576640 00000100:00100000:2.0:1787114839.550377:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624576640 00000100:00100000:2.0:1787114839.550415:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787114839.550423:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:7467:x1873925624576640:12345-0@lo:501: 00000100:00100000:2.0:1787114839.550670:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:7467:x1873925624576640:12345-0@lo:501: Request processed in 247us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114839.550677:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787114839.550850:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051360a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624576640:0@lo:501: 00000100:00100000:3.0:1787114839.550882:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624576768:0@lo:503: 00000100:00100000:3.0:1787114839.550922:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114839.550955:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050797e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787114839.551008:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624576768 00000100:00100000:2.0:1787114839.551013:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624576768 00000100:00100000:2.0:1787114839.551044:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787114839.551051:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:7467:x1873925624576768:12345-0@lo:503: 00000100:00100000:2.0:1787114839.551459:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:7467:x1873925624576768:12345-0@lo:503: Request processed in 407us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114839.551465:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787114839.551550:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624576512 00000100:00100000:1.0:1787114839.551556:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624576512 00000100:00100000:0.0:1787114839.551664:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787114839.551673:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051363800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:3309:x1873925624576512:12345-0@lo:103: 00010000:00010000:0.0:1787114839.551695:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787114839.551711:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af052365e00/0x194cd781e88c81fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x194cd781e88c81f3 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114839.551726:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787114839.551769:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051363800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:3309:x1873925624576512:12345-0@lo:103: Request processed in 97us (1962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114839.551776:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787114839.551921:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624576512:0@lo:103: 00000100:00100000:3.0:1787114839.551978:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624576768:0@lo:503: 00000040:00080000:2.0:1787114839.552634:0:7467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787114839.552771:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624576896:0@lo:502: 00000100:00100000:2.0:1787114839.552825:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114839.552897:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06e9273c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787114839.552934:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624576896 00000100:00100000:0.0:1787114839.552940:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624576896 00000100:00100000:0.0:1787114839.553006:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787114839.553022:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:7467:x1873925624576896:12345-0@lo:502: 00000100:00100000:0.0:1787114839.553503:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:7467:x1873925624576896:12345-0@lo:502: Request processed in 481us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114839.553510:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787114839.553595:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624576896:0@lo:502: 00000040:00080000:3.0:1787114839.553891:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787114839.553945:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787114839.553983:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787114839.554030:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787114839.554066:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787114839.554098:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787114839.554280:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624577024:0@lo:502: 00000100:00100000:3.0:1787114839.554389:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114839.554535:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050797cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787114839.554627:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624577024 00000100:00100000:2.0:1787114839.554633:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624577024 00000100:00100000:2.0:1787114839.554663:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787114839.554670:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:7467:x1873925624577024:12345-0@lo:502: 00000100:00100000:2.0:1787114839.554836:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:7467:x1873925624577024:12345-0@lo:502: Request processed in 165us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114839.554842:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787114839.554964:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624577024:0@lo:502: 00000040:00080000:3.0:1787114839.555053:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787114839.555063:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1787114839.555743:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787114839.555751:0:7474:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787114839.555758:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787114839.555760:0:7474:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787114839.555773:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787114839.555788:0:7474:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8af06eeab380) 00000020:00000080:2.0:1787114839.555812:0:7474:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787114839.555819:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787114839.555880:0:7474:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af07b581000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787114839.555887:0:7474:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787114839.555894:0:7474:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x194cd781e88c8216 00010000:00010000:2.0:1787114839.559576:0:7474:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1787114839.559885:0:7474:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787114839.562026:0:7474:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787114839.562552:0:7474:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787114839.568037:0:7474:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787114839.568844:0:7474:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787114839.570374:0:7474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787114839.570389:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787114839.570395:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787114839.570397:0:7474:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787114839.570402:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787114839.570406:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787114839.570407:0:7474:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787114839.570410:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787114839.570412:0:7474:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787114839.570458:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787114839.570461:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787114839.570463:0:7474:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787114839.570465:0:7474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787114839.570972:0:7467:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787114839.571002:0:7467:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787114839.571056:0:7467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c8201 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8208 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114839.571071:0:7467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c8201 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8208 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787114839.571085:0:7467:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af07b581000 from 1 10000000:01000000:3.0:1787114839.571088:0:7467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787114839.571246:0:7467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429cbe00/0x194cd781e88c821d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114839.571256:0:7467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af0429cbe00/0x194cd781e88c821d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114839.571268:0:7467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af0429cbe00/0x194cd781e88c821d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114839.571351:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624577152:0@lo:101: 00000100:00100000:3.0:1787114839.571424:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114839.571473:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050797cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787114839.571548:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624577152 00000100:00100000:1.0:1787114839.571557:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624577152 00000100:00100000:1.0:1787114839.571603:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787114839.571612:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:7467:x1873925624577152:12345-0@lo:101: 00010000:00010000:1.0:1787114839.571626:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787114839.571639:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af041682000/0x194cd781e88c8224 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c821d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.571663:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af041682000/0x194cd781e88c8224 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c821d expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.571675:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af041682000/0x194cd781e88c8224 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c821d expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.571695:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041682000, rc 0) 00000100:00100000:1.0:1787114839.571741:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:7467:x1873925624577152:12345-0@lo:101: Request processed in 131us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114839.571749:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787114839.571895:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624577152:0@lo:101: 00010000:00010000:3.0:1787114839.571910:0:7467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af0429cbe00/0x194cd781e88c821d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8224 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114839.571922:0:7467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af0429cbe00/0x194cd781e88c821d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8224 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114839.572024:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624577280:0@lo:501: 00000100:00100000:3.0:1787114839.572049:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114839.572083:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050797cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787114839.572148:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624577280 00000100:00100000:1.0:1787114839.572162:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624577280 00000100:00100000:1.0:1787114839.572191:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787114839.572198:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:7467:x1873925624577280:12345-0@lo:501: 00000100:00100000:1.0:1787114839.572587:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:7467:x1873925624577280:12345-0@lo:501: Request processed in 389us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114839.572600:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787114839.572634:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624577280:0@lo:501: 00000100:00100000:1.0:1787114839.572664:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624577408:0@lo:503: 00000100:00100000:0.0:1787114839.573730:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114839.573780:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045a37600 going to sleep for 11 seconds 00000100:00100000:1.0:1787114839.573825:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624577408 00000100:00100000:1.0:1787114839.573832:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624577408 00000100:00100000:1.0:1787114839.573874:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787114839.573883:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:7467:x1873925624577408:12345-0@lo:503: 00000100:00100000:1.0:1787114839.574258:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:7467:x1873925624577408:12345-0@lo:503: Request processed in 375us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114839.574266:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787114839.574751:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624577408:0@lo:503: 00000040:00080000:0.0:1787114839.575079:0:7467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787114839.575192:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051360a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624577536:0@lo:502: 00000100:00100000:0.0:1787114839.575464:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114839.575502:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624577536 00000100:00100000:0.0:1787114839.575507:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624577536 00000100:00100000:0.0:1787114839.575699:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787114839.575708:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051311050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:7467:x1873925624577536:12345-0@lo:502: 00000100:00100000:0.0:1787114839.576096:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051311050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:7467:x1873925624577536:12345-0@lo:502: Request processed in 388us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114839.576103:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787114839.576375:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af07b83f900 going to sleep for 11 seconds 00000100:00100000:0.0:1787114839.576393:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051360a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624577536:0@lo:502: 00000040:00080000:0.0:1787114839.576772:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787114839.576821:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787114839.576849:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051360a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624577664:0@lo:502: 00000100:00100000:0.0:1787114839.576887:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114839.576919:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045afe300 going to sleep for 11 seconds 00000100:00100000:1.0:1787114839.577147:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624577664 00000100:00100000:1.0:1787114839.577215:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624577664 00000100:00100000:1.0:1787114839.577257:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787114839.577265:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051312c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:7467:x1873925624577664:12345-0@lo:502: 00000100:00100000:1.0:1787114839.577500:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051312c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:7467:x1873925624577664:12345-0@lo:502: Request processed in 235us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114839.577506:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787114839.577769:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051360a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624577664:0@lo:502: 00000040:00080000:2.0:1787114839.577850:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787114839.577859:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787114839.578861:0:7478:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787114839.578873:0:7478:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787114839.578876:0:7478:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787114839.578882:0:7478:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8af07b581000 00000020:00000080:3.0:1787114839.578894:0:7478:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787114839.578919:0:7478:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787114839.578923:0:7478:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787114839.578924:0:7478:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787114839.578927:0:7478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787114839.578990:0:7467:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787114839.579009:0:7467:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787114839.579031:0:7467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429cbe00/0x194cd781e88c821d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8224 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.579049:0:7467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af0429cbe00/0x194cd781e88c821d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8224 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787114839.579088:0:7467:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787114839.579090:0:7467:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8af07b581000 10000000:01000000:2.0:1787114839.579093:0:7467:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8af07b581000 10000000:01000000:2.0:1787114839.579096:0:7467:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787114839.579102:0:7467:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8af07b581000 from 1 10000000:01000000:2.0:1787114839.579103:0:7467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787114839.579440:0:7467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c822b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114839.579465:0:7467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c822b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114839.579477:0:7467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c822b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114839.579498:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051363480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624577792:0@lo:101: 00000100:00100000:0.0:1787114839.579572:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114839.579619:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045afe300 going to sleep for 11 seconds 00000100:00100000:2.0:1787114839.579729:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624577792 00000100:00100000:2.0:1787114839.579736:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624577792 00000100:00100000:2.0:1787114839.579775:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787114839.579783:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051311850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:7467:x1873925624577792:12345-0@lo:101: 00010000:00010000:2.0:1787114839.579797:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114839.579809:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af042cb2c00/0x194cd781e88c8232 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c822b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.579834:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af042cb2c00/0x194cd781e88c8232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c822b expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.579844:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af042cb2c00/0x194cd781e88c8232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c822b expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114839.579854:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2c00, rc 0) 00000100:00100000:2.0:1787114839.579957:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051311850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:7467:x1873925624577792:12345-0@lo:101: Request processed in 173us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114839.579964:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787114839.580465:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051363480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624577792:0@lo:101: 00010000:00010000:1.0:1787114839.580485:0:7467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c822b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8232 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.580493:0:7467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c822b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8232 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114839.580675:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624577920:0@lo:501: 00000100:00100000:1.0:1787114839.580718:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114839.580785:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045a373c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787114839.580826:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624577920 00000100:00100000:2.0:1787114839.580837:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624577920 00000100:00100000:2.0:1787114839.580904:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787114839.580912:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051313850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:7467:x1873925624577920:12345-0@lo:501: 00000100:00100000:2.0:1787114839.581444:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051313850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:7467:x1873925624577920:12345-0@lo:501: Request processed in 533us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114839.581451:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787114839.581544:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624577920:0@lo:501: 00000100:00100000:1.0:1787114839.581585:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624578048:0@lo:503: 00000100:00100000:1.0:1787114839.581628:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114839.581913:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045a373c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787114839.582010:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624578048 00000100:00100000:0.0:1787114839.582016:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624578048 00000100:00100000:0.0:1787114839.582041:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787114839.582049:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051310850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:7467:x1873925624578048:12345-0@lo:503: 00000100:00100000:0.0:1787114839.582394:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051310850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:7467:x1873925624578048:12345-0@lo:503: Request processed in 345us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114839.582401:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787114839.582620:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624578048:0@lo:503: 00000040:00080000:1.0:1787114839.582963:0:7467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787114839.583051:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624578176:0@lo:502: 00000100:00100000:1.0:1787114839.583092:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114839.583151:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045a373c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787114839.583460:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624578176 00000100:00100000:2.0:1787114839.583467:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624578176 00000100:00100000:2.0:1787114839.583549:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787114839.583567:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051310450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:7467:x1873925624578176:12345-0@lo:502: 00000100:00100000:2.0:1787114839.583789:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051310450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:7467:x1873925624578176:12345-0@lo:502: Request processed in 232us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114839.583796:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787114839.583877:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624578176:0@lo:502: 00000040:00080000:1.0:1787114839.584152:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787114839.584215:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787114839.584473:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787114839.584560:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787114839.584614:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787114839.584664:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787114839.584701:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787114839.584736:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787114839.584787:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787114839.584824:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787114839.584858:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787114839.584906:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787114839.584940:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787114839.584972:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787114839.585359:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787114839.585407:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787114839.585453:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787114839.585496:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787114839.585542:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787114839.585706:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787114839.585750:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787114839.585780:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787114839.585812:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787114839.585861:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787114839.585898:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787114839.585933:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787114839.585980:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787114839.586044:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1787114839.586084:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787114839.586394:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1787114839.586436:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1787114839.586470:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1787114839.586503:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1787114839.586638:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1787114839.586671:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1787114839.586714:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1787114839.586743:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1787114839.586789:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624578304:0@lo:502: 00000100:00100000:1.0:1787114839.586865:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114839.592793:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624578304 00000100:00100000:0.0:1787114839.592810:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624578304 00000100:00100000:0.0:1787114839.593005:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787114839.593017:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051313450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:7467:x1873925624578304:12345-0@lo:502: 00000100:00100000:0.0:1787114839.593706:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051313450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:7467:x1873925624578304:12345-0@lo:502: Request processed in 689us (6838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114839.593715:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787114839.593839:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045a373c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787114839.593869:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624578304:0@lo:502: 00000040:00080000:1.0:1787114839.594020:0:7467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1787114839.594036:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1787114839.595403:0:7479:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787114839.595420:0:7479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8af07fb24d40) 00000020:00000080:1.0:1787114839.595445:0:7479:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1787114839.595721:0:7479:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af07b581000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787114839.595730:0:7479:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8af07b581000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787114839.595733:0:7479:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af07b581000 3 00010000:00080000:1.0:1787114839.595761:0:7479:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8af06f295800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.110@tcp at head 00010000:00010000:1.0:1787114839.606356:0:7479:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1787114839.606470:0:7479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787114839.606540:0:7479:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787114839.609146:0:7479:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x194cd781e88c8240 00000100:00080000:1.0:1787114839.609165:0:7479:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787114839.609185:0:7479:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8af06f295800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:1.0:1787114839.609249:0:7479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af042cb8700 x1873925624578432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787114839.609281:0:7479:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787114839.609648:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787114839.609669:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051362d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624578560:0@lo:400: 00000100:00100000:0.0:1787114839.609742:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114839.609815:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624578688:0@lo:400: 00000100:00100000:0.0:1787114839.609859:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114839.609881:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787114839.609887:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624578816:0@lo:400: 00000100:00100000:0.0:1787114839.609913:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114839.610067:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624578560 00000100:00100000:0.0:1787114839.610075:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624578560 00000100:00100000:0.0:1787114839.610149:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624578688 00000100:00100000:0.0:1787114839.610152:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624578688 00000100:00100000:0.0:1787114839.610341:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787114839.610352:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624578560:12345-0@lo:400: 00000100:00100000:0.0:1787114839.610412:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624578560:12345-0@lo:400: Request processed in 61us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114839.610419:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787114839.610437:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787114839.610444:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624578688:12345-0@lo:400: 00000100:00100000:0.0:1787114839.610475:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624578688:12345-0@lo:400: Request processed in 32us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114839.610482:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787114839.610508:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624578816 00000100:00100000:0.0:1787114839.610512:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624578816 00000100:00100000:0.0:1787114839.610625:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787114839.610634:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624578816:12345-0@lo:400: 00000100:00100000:0.0:1787114839.610668:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624578816:12345-0@lo:400: Request processed in 37us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114839.610674:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787114839.610695:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787114839.610699:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787114839.610883:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af051363480 x1873925624578816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114839.610900:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624578816:0@lo:400: 00010000:00080000:0.0:1787114839.610912:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af051361880 x1873925624578688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787114855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114839.610920:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624578688:0@lo:400: 00010000:00080000:1.0:1787114839.611165:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af051362d80 x1873925624578560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787114855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114839.611176:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051362d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624578560:0@lo:400: 00000100:00100000:3.0:1787114839.617139:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1873925624578432:0@lo:38: 00000100:00100000:3.0:1787114839.617234:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114839.617661:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624578432 00000100:00100000:0.0:1787114839.617671:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624578432 00000100:00100000:0.0:1787114839.617724:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787114839.617732:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1873925624578432:12345-0@lo:38: 00010000:00080000:0.0:1787114839.617764:0:5787:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:0.0:1787114839.617809:0:5787:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x194cd781e88c8247 00000004:00100000:0.0:1787114839.617827:0:5787:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787114839.618212:0:7481:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8af0591d4e00 x1873925624578944/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114839.618222:0:7481:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0507973c0 going to sleep for 0 seconds 00000040:00080000:1.0:1787114839.618658:0:7479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:0.0:1787114839.618860:0:5787:0:(import.c:65:import_set_state_nolock()) ffff8af077cc6000 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1787114839.619367:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af042cb8700 x1873925624578432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787114849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114839.619380:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787114839.619389:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787114839.619397:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787114839.619403:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787114839.619406:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af06f295800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787114839.619413:0:3305:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000091c0058c): req@ffff8af0591d4e00 x1873925624578944/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114839.619433:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1873925624578432:0@lo:38: 00000100:00100000:0.0:1787114839.619655:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873925624578432:12345-0@lo:38: Request processed in 1920us (2419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114839.619664:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000000:0.0:1787114839.619696:0:7467:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787114839.619721:0:7467:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787114839.619735:0:7467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c822b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8232 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114839.619745:0:7467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c822b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8232 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787114839.619793:0:7467:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787114839.619795:0:7467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787114839.619800:0:7467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787114839.619801:0:7467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787114839.619802:0:7467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787114839.619804:0:7467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787114839.619805:0:7467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787114839.619806:0:7467:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787114839.619808:0:7467:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787114839.619809:0:7467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787114839.619811:0:7467:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787114839.619815:0:7467:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787114839.619817:0:7467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787114839.619818:0:7467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787114839.619819:0:7467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787114839.619820:0:7467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787114839.619821:0:7467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787114839.619822:0:7467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787114839.619822:0:7467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787114839.619823:0:7467:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787114839.619824:0:7467:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787114839.619825:0:7467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787114839.619826:0:7467:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787114839.619844:0:7467:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787114839.619855:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624579072:0@lo:253: 00000100:00100000:0.0:1787114839.619903:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114839.620378:0:7481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114839.620468:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624578944 00000100:00100000:1.0:1787114839.620475:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624578944 00000100:00100000:1.0:1787114839.620540:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787114839.620548:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7481:x1873925624578944:12345-0@lo:901: 00000100:00080000:0.0:1787114839.621050:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787114839.621069:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af07b47f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787114839.621260:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624579072 00000100:00100000:3.0:1787114839.621267:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624579072 00000100:00100000:2.0:1787114839.621321:0:7481:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0507973c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787114839.621366:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787114839.621373:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051311450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:7467:x1873925624579072:12345-0@lo:253: 20000000:01000000:3.0:1787114839.621394:0:5780:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787114839.621406:0:5780:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787114839.622791:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7481:x1873925624578944:12345-0@lo:901: Request processed in 2237us (2405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114839.622803:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787114839.624145:0:7481:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af0591d4e00 x1873925624578944/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787114855 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114839.624166:0:7481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d4e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7481:1873925624578944:0@lo:901: 20000000:01000000:3.0:1787114839.702436:0:5780:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787114839.702455:0:5780:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787114839.702695:0:5801:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787114839.702701:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787114839.702724:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8af041682a00/0x194cd781e88c824e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.702744:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af08216e200/0x194cd781e88c819f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8198 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.702752:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8af041682a00/0x194cd781e88c824e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.702791:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af08216e200/0x194cd781e88c819f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c8198 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.702807:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af08216e200/0x194cd781e88c819f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c8198 expref: 14 pid: 5780 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114839.702823:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5801:1873925624579200:0@lo:104: 00000100:00100000:1.0:1787114839.702900:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114839.702973:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045a37000 going to sleep for 11 seconds 00000100:00100000:0.0:1787114839.703173:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624579200 00000100:00100000:0.0:1787114839.703191:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624579200 00000100:00100000:0.0:1787114839.703256:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787114839.703265:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:5801:x1873925624579200:12345-0@lo:104: 00010000:00010000:0.0:1787114839.703279:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af08216f800/0x194cd781e88c8198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c819f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114839.703338:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787114839.703344:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:5801:x1873925624579200:12345-0@lo:104: Request processed in 81us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114839.703369:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787114839.703513:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5801:1873925624579200:0@lo:104: 00010000:00010000:3.0:1787114839.703546:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8af041682a00/0x194cd781e88c824e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.703675:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787114839.703683:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af08216f800/0x194cd781e88c8198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c819f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.703703:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216f800 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1787114839.703708:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af08216f800/0x194cd781e88c8198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c819f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.703715:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af08216f800/0x194cd781e88c8198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c819f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787114839.703722:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af08216f800/0x194cd781e88c8198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c819f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787114839.703728:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787114839.703766:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af08216f800/0x194cd781e88c8198 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c819f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.703774:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787114839.703801:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af08216f800/0x194cd781e88c8198 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c819f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.703809:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af08216f800/0x194cd781e88c8198 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c819f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.703828:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114839.703830:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114839.703832:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114839.703839:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787114839.703851:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624579328:0@lo:103: 00000100:00100000:1.0:1787114839.703887:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114839.703922:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624579328 00000100:00100000:1.0:1787114839.703926:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624579328 00010000:00010000:1.0:1787114839.704096:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af08216e200/0x194cd781e88c819f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8198 expref: 15 pid: 5780 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114839.704253:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787114839.704261:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:3309:x1873925624579328:12345-0@lo:103: 00010000:00010000:1.0:1787114839.704273:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787114839.704278:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af08216e200/0x194cd781e88c819f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8198 expref: 15 pid: 5780 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.704288:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af08216e200/0x194cd781e88c819f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c8198 expref: 15 pid: 5780 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.704301:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af08216e200/0x194cd781e88c819f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c8198 expref: 15 pid: 5780 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.704316:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8af041682a00/0x194cd781e88c824e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.704324:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af041682a00/0x194cd781e88c824e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787114839.704337:0:5771:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006140159s 00010000:00010000:1.0:1787114839.704342:0:5771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af041682a00/0x194cd781e88c824e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.704349:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af041682a00/0x194cd781e88c824e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.704357:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8af041682a00/0x194cd781e88c824e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.704363:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8af041682a00/0x194cd781e88c824e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.704375:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682a00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:1.0:1787114839.704380:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8af041682a00/0x194cd781e88c824e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.704387:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8af041682a00/0x194cd781e88c824e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.704409:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8af041682a00/0x194cd781e88c824e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114839.704418:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787114839.704448:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:3309:x1873925624579328:12345-0@lo:103: Request processed in 189us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114839.704454:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787114839.704631:0:5801:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8af041682a00/0x194cd781e88c824e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114839.704640:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8af041682a00/0x194cd781e88c824e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114839.704646:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af041682a00/0x194cd781e88c824e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114839.706440:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624579328:0@lo:103: 00000100:00100000:3.0:1787114839.723141:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051311450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:7467:x1873925624579072:12345-0@lo:253: Request processed in 101733us (103203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114839.723156:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787114839.723284:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6bfcc0b7-8035-40e1-91c8-e687d170788c:7467:1873925624579072:0@lo:253: 10000000:01000000:0.0:1787114839.723301:0:7467:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787114839.723305:0:7467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787114839.723306:0:7467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787114839.723308:0:7467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787114839.723309:0:7467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787114839.723310:0:7467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787114839.723311:0:7467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787114839.723312:0:7467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787114839.723313:0:7467:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787114839.723315:0:7467:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787114839.723316:0:7467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787114839.723318:0:7467:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787114839.723332:0:7467:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787114839.727948:0:7467:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787114839.728268:0:7467:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787114839.728472:0:7467:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787114839.729043:0:7467:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787114839.729274:0:7467:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787114839.729528:0:7467:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787114839.730867:0:7467:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787114839.999975:0:7467:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787114839.999982:0:7467:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787114840.000021:0:7467:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787114840.000085:0:7467:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.110@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787114840.000100:0:7467:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787114840.000164:0:7467:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787114840.262250:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787114840.967562:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787114840.967598:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624579456:0@lo:13: 00000100:00100000:3.0:1787114840.967700:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114840.967860:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624579456 00000100:00100000:0.0:1787114840.967869:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624579456 00000100:00100000:0.0:1787114840.967940:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787114840.967952:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624579456:12345-0@lo:13: 00002000:00000024:0.0:1787114840.967988:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787114840.968042:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624579456:12345-0@lo:13: Request processed in 93us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114840.968050:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787114840.969076:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07fb96300 x1873925624579456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114840.969143:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624579456:0@lo:13: 00010000:00010000:1.0:1787114841.287346:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114842.310412:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114843.344070:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114844.357291:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114845.061353:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624579584:0@lo:400: 00000100:00100000:0.0:1787114845.061437:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114845.061519:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624580096:0@lo:400: 00000100:00100000:0.0:1787114845.061549:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114845.061588:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787114845.061594:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624579712:0@lo:400: 00000100:00100000:0.0:1787114845.061616:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114845.061645:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624579840:0@lo:400: 00000100:00100000:0.0:1787114845.061668:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114845.061687:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787114845.061692:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624579968:0@lo:400: 00000100:00100000:0.0:1787114845.061718:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114845.061752:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624579584 00000100:00100000:0.0:1787114845.061759:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624579584 00000100:00100000:0.0:1787114845.061806:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787114845.061815:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051312450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:3306:x1873925624579584:12345-0@lo:400: 00000100:00100000:0.0:1787114845.061859:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051312450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:3306:x1873925624579584:12345-0@lo:400: Request processed in 46us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114845.061877:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787114845.061927:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624580096 00000100:00100000:0.0:1787114845.061930:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624580096 00000100:00100000:0.0:1787114845.061964:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624579712 00000100:00100000:0.0:1787114845.061967:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624579712 00000100:00100000:0.0:1787114845.061977:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624579840 00000100:00100000:0.0:1787114845.061980:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624579840 00000100:00100000:0.0:1787114845.061992:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787114845.061998:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624580096:12345-0@lo:400: 00000100:00100000:0.0:1787114845.062253:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624580096:12345-0@lo:400: Request processed in 254us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114845.062261:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787114845.062274:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787114845.062281:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624579712:12345-0@lo:400: 00000100:00100000:0.0:1787114845.062313:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624579712:12345-0@lo:400: Request processed in 33us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114845.062319:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787114845.062329:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787114845.062335:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624579840:12345-0@lo:400: 00000100:00100000:0.0:1787114845.062367:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624579840:12345-0@lo:400: Request processed in 32us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114845.062373:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787114845.062397:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624579968 00000100:00100000:0.0:1787114845.062401:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624579968 00000100:00100000:0.0:1787114845.062441:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787114845.062448:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624579968:12345-0@lo:400: 00000100:00100000:0.0:1787114845.062490:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624579968:12345-0@lo:400: Request processed in 43us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114845.062503:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787114845.062523:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787114845.062527:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787114845.062560:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07fb96d80 x1873925624579968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114845.062574:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624579968:0@lo:400: 00010000:00080000:0.0:1787114845.062584:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07fb97b80 x1873925624579840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787114861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114845.062593:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624579840:0@lo:400: 00010000:00080000:0.0:1787114845.062618:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07fb97480 x1873925624579712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787114861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114845.062628:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624579712:0@lo:400: 00000100:00100000:0.0:1787114845.062637:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624579584:0@lo:400: 00010000:00080000:0.0:1787114845.062646:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07fb97800 x1873925624580096/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787114861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114845.062654:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624580096:0@lo:400: 00010000:00010000:1.0:1787114845.383349:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787114846.086570:0:5782:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787114846.086580:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8af06f41d000 from 30 10000000:01000000:0.0:1787114846.086586:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787114846.086653:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114846.086665:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114846.086696:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114846.086721:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb97800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624580224:0@lo:101: 00000100:00100000:0.0:1787114846.086789:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114846.086843:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af07b8e1600 going to sleep for 11 seconds 00000100:00100000:2.0:1787114846.089762:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624580224 00000100:00100000:2.0:1787114846.089784:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624580224 00000100:00100000:2.0:1787114846.089881:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787114846.089891:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051312050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:5782:x1873925624580224:12345-0@lo:101: 00010000:00010000:2.0:1787114846.089909:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114846.089927:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af042cb3c00/0x194cd781e88c825c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8255 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114846.089965:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af042cb3c00/0x194cd781e88c825c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8255 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114846.089978:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af042cb3c00/0x194cd781e88c825c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8255 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114846.089989:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3c00, rc 0) 00000100:00100000:2.0:1787114846.090068:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051312050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:5782:x1873925624580224:12345-0@lo:101: Request processed in 178us (3278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114846.090074:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787114846.090160:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb97800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624580224:0@lo:101: 00010000:00010000:2.0:1787114846.090179:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8255 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c825c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114846.090190:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8255 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c825c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114846.090262:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624580352:0@lo:501: 00000100:00100000:2.0:1787114846.090297:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114846.090331:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042d2d300 going to sleep for 11 seconds 00000100:00100000:2.0:1787114846.090345:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624580352 00000100:00100000:2.0:1787114846.090349:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624580352 00000100:00100000:2.0:1787114846.090373:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787114846.090380:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051310050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:5782:x1873925624580352:12345-0@lo:501: 00000100:00100000:2.0:1787114846.091184:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051310050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:5782:x1873925624580352:12345-0@lo:501: Request processed in 801us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114846.091193:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787114846.091252:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624580352:0@lo:501: 00000100:00100000:2.0:1787114846.091293:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624580480:0@lo:503: 00000100:00100000:2.0:1787114846.091338:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114846.091355:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042d2d300 going to sleep for 11 seconds 00000100:00100000:2.0:1787114846.091372:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624580480 00000100:00100000:2.0:1787114846.091377:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624580480 00000100:00100000:2.0:1787114846.091401:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787114846.091408:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051311c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:5782:x1873925624580480:12345-0@lo:503: 00000100:00100000:2.0:1787114846.096029:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051311c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:5782:x1873925624580480:12345-0@lo:503: Request processed in 4610us (4680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114846.096044:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787114846.096153:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624580480:0@lo:503: 00000100:00100000:0.0:1787114846.101096:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624580608:0@lo:13: 00000100:00100000:0.0:1787114846.101201:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114846.101266:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624580608 00000100:00100000:0.0:1787114846.101273:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624580608 00000100:00100000:0.0:1787114846.101322:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787114846.101331:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624580608:12345-0@lo:13: 00002000:00000024:0.0:1787114846.101364:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787114846.101409:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624580608:12345-0@lo:13: Request processed in 79us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114846.101415:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787114846.101450:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07fb95180 x1873925624580608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114846.101481:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624580608:0@lo:13: 00000100:00100000:0.0:1787114846.101590:0:7767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:7767:1873925624580736:0@lo:502: 00000100:00100000:0.0:1787114846.101837:0:7767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114846.102135:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624580736 00000100:00100000:0.0:1787114846.102140:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624580736 00000100:00100000:0.0:1787114846.102167:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787114846.102174:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051313050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:7767:x1873925624580736:12345-0@lo:502: 00000100:00100000:0.0:1787114846.102495:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051313050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:7767:x1873925624580736:12345-0@lo:502: Request processed in 319us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114846.102502:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787114846.102550:0:7767:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af07b8e1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787114846.102568:0:7767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:7767:1873925624580736:0@lo:502: 00000100:00100000:0.0:1787114846.102617:0:7767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:7767:1873925624580864:0@lo:502: 00000100:00100000:3.0:1787114846.106805:0:7767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114846.106864:0:7767:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af07b8e1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787114846.108469:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624580864 00000100:00100000:0.0:1787114846.108484:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624580864 00000100:00100000:0.0:1787114846.108547:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787114846.108556:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051313c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:7767:x1873925624580864:12345-0@lo:502: 00000100:00100000:0.0:1787114846.108824:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051313c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:7767:x1873925624580864:12345-0@lo:502: Request processed in 269us (2022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114846.108832:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787114846.108988:0:7767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:7767:1873925624580864:0@lo:502: 00000040:00080000:3.0:1787114846.109020:0:7767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787114846.109267:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787114846.109289:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787114846.109298:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c825c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114846.109309:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c825c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114846.109318:0:5782:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787114846.109320:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787114846.109322:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787114846.109351:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c8263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114846.109359:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c8263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114846.109374:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c8263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114846.109391:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb97b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624580992:0@lo:101: 00000100:00100000:0.0:1787114846.109420:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114846.109455:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af07b8e1240 going to sleep for 11 seconds 00000100:00100000:3.0:1787114846.113060:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624580992 00000100:00100000:3.0:1787114846.113076:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624580992 00000100:00100000:3.0:1787114846.113160:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787114846.113170:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051312850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:5782:x1873925624580992:12345-0@lo:101: 00010000:00010000:3.0:1787114846.113191:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787114846.113210:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af0429ca800/0x194cd781e88c826a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8263 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114846.113238:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af0429ca800/0x194cd781e88c826a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8263 expref: 15 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114846.113249:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af0429ca800/0x194cd781e88c826a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8263 expref: 15 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114846.113258:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429ca800, rc 0) 00000100:00100000:3.0:1787114846.113332:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051312850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:5782:x1873925624580992:12345-0@lo:101: Request processed in 163us (3910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114846.113339:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787114846.113394:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb97b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624580992:0@lo:101: 00010000:00010000:3.0:1787114846.113409:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c8263 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c826a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114846.113431:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c8263 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c826a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114846.113504:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624581120:0@lo:501: 00000100:00100000:3.0:1787114846.113531:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114846.113555:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04d4db3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787114846.113565:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624581120 00000100:00100000:3.0:1787114846.113568:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624581120 00000100:00100000:3.0:1787114846.113584:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787114846.113589:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051310c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:5782:x1873925624581120:12345-0@lo:501: 00000100:00100000:3.0:1787114846.113821:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051310c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:5782:x1873925624581120:12345-0@lo:501: Request processed in 230us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114846.113828:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787114846.114006:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624581120:0@lo:501: 00000100:00100000:3.0:1787114846.114035:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624581248:0@lo:503: 00000100:00100000:3.0:1787114846.114073:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114846.114085:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04d4db3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787114846.114096:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624581248 00000100:00100000:3.0:1787114846.114099:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624581248 00000100:00100000:3.0:1787114846.114143:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787114846.114149:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:5782:x1873925624581248:12345-0@lo:503: 00000100:00100000:3.0:1787114846.114414:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:5782:x1873925624581248:12345-0@lo:503: Request processed in 265us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114846.114421:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787114846.114456:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624581248:0@lo:503: 00000100:00100000:1.0:1787114846.115724:0:7768:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:7768:1873925624581376:0@lo:502: 00000100:00100000:1.0:1787114846.115792:0:7768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114846.115839:0:7768:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04303f180 going to sleep for 11 seconds 00000100:00100000:3.0:1787114846.116167:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624581376 00000100:00100000:3.0:1787114846.116174:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624581376 00000100:00100000:3.0:1787114846.116211:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787114846.116219:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:7768:x1873925624581376:12345-0@lo:502: 00000100:00100000:3.0:1787114846.116500:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:7768:x1873925624581376:12345-0@lo:502: Request processed in 281us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114846.116509:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787114846.119211:0:7768:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:7768:1873925624581376:0@lo:502: 00000020:01000000:1.0:1787114846.119266:0:7768:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787114846.119284:0:7768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787114846.119296:0:7768:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787114846.119303:0:7768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787114846.119304:0:7768:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787114846.119342:0:7768:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:7768:1873925624581504:0@lo:502: 00000100:00100000:1.0:1787114846.119415:0:7768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114846.119471:0:7768:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04303f180 going to sleep for 11 seconds 00000100:00100000:0.0:1787114846.119572:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624581504 00000100:00100000:0.0:1787114846.119579:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624581504 00000100:00100000:0.0:1787114846.119636:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787114846.119646:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:7768:x1873925624581504:12345-0@lo:502: 00000100:00100000:0.0:1787114846.120046:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:7768:x1873925624581504:12345-0@lo:502: Request processed in 401us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114846.120054:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787114846.120210:0:7768:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:7768:1873925624581504:0@lo:502: 00000020:01000000:1.0:1787114846.120232:0:7768:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787114846.120237:0:7768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787114846.120239:0:7768:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787114846.120242:0:7768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787114846.120424:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787114846.120446:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787114846.120467:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c8263 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c826a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114846.120477:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c8263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c826a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114846.120487:0:5782:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787114846.120489:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8af05032f000 from 30 10000000:01000000:0.0:1787114846.120493:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787114846.120519:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365000/0x194cd781e88c8271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114846.120527:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af052365000/0x194cd781e88c8271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114846.120544:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af052365000/0x194cd781e88c8271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114846.120560:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624581632:0@lo:101: 00000100:00100000:0.0:1787114846.120592:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114846.120693:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af07b8e1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787114846.120775:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624581632 00000100:00100000:3.0:1787114846.120780:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624581632 00000100:00100000:3.0:1787114846.120819:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787114846.120827:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:5782:x1873925624581632:12345-0@lo:101: 00010000:00010000:3.0:1787114846.120836:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787114846.120981:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af0429cb400/0x194cd781e88c8278 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8271 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114846.121005:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af0429cb400/0x194cd781e88c8278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8271 expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114846.121015:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af0429cb400/0x194cd781e88c8278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8271 expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114846.121023:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429cb400, rc 0) 00000100:00100000:3.0:1787114846.121056:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:5782:x1873925624581632:12345-0@lo:101: Request processed in 231us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114846.121062:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787114846.121211:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624581632:0@lo:101: 00010000:00010000:0.0:1787114846.121226:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af052365000/0x194cd781e88c8271 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8278 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114846.121235:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af052365000/0x194cd781e88c8271 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8278 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114846.121282:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624581760:0@lo:501: 00000100:00100000:0.0:1787114846.121306:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114846.121327:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af07b8e1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787114846.121340:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624581760 00000100:00100000:0.0:1787114846.121344:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624581760 00000100:00100000:0.0:1787114846.121369:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787114846.121376:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:5782:x1873925624581760:12345-0@lo:501: 00000100:00100000:0.0:1787114846.121616:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:5782:x1873925624581760:12345-0@lo:501: Request processed in 241us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114846.123815:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787114846.123933:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624581760:0@lo:501: 00000100:00100000:0.0:1787114846.123988:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624581888:0@lo:503: 00000100:00100000:0.0:1787114846.124066:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114846.124101:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af07b8e1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787114846.124400:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624581888 00000100:00100000:3.0:1787114846.124407:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624581888 00000100:00100000:3.0:1787114846.124446:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787114846.124456:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:5782:x1873925624581888:12345-0@lo:503: 00000100:00100000:3.0:1787114846.124696:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:5782:x1873925624581888:12345-0@lo:503: Request processed in 240us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114846.124703:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787114846.126481:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624581888:0@lo:503: 00000100:00100000:0.0:1787114846.128180:0:7769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb94700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:7769:1873925624582016:0@lo:502: 00000100:00100000:0.0:1787114846.128257:0:7769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114846.128311:0:7769:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af05908e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787114846.128375:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624582016 00000100:00100000:2.0:1787114846.128382:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624582016 00000100:00100000:2.0:1787114846.128480:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787114846.128490:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:7769:x1873925624582016:12345-0@lo:502: 00000100:00100000:2.0:1787114846.128734:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:7769:x1873925624582016:12345-0@lo:502: Request processed in 244us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114846.128741:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787114846.138007:0:7769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb94700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:7769:1873925624582016:0@lo:502: 00000100:00100000:0.0:1787114846.138104:0:7769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb94700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:7769:1873925624582144:0@lo:502: 00000100:00100000:0.0:1787114846.138209:0:7769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114846.138265:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624582144 00000100:00100000:0.0:1787114846.138272:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624582144 00000100:00100000:0.0:1787114846.138327:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787114846.138336:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:7769:x1873925624582144:12345-0@lo:502: 00000100:00100000:0.0:1787114846.138582:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:7769:x1873925624582144:12345-0@lo:502: Request processed in 246us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114846.138590:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787114846.139808:0:7769:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af05908e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787114846.139837:0:7769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb94700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:7769:1873925624582144:0@lo:502: 00000040:00080000:0.0:1787114846.140227:0:7769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787114846.148761:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787114846.148799:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787114846.148810:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365000/0x194cd781e88c8271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8278 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114846.148824:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af052365000/0x194cd781e88c8271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8278 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787114846.148834:0:5782:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787114846.148837:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8af05032f000 from 5 10000000:01000000:3.0:1787114846.148840:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787114846.149049:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429cbc00/0x194cd781e88c827f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114846.149058:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af0429cbc00/0x194cd781e88c827f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114846.149068:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af0429cbc00/0x194cd781e88c827f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114846.149093:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624582272:0@lo:101: 00000100:00100000:3.0:1787114846.149452:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114846.149503:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04d4db3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787114846.149505:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624582272 00000100:00100000:2.0:1787114846.149512:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624582272 00000100:00100000:2.0:1787114846.149561:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787114846.149571:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:5782:x1873925624582272:12345-0@lo:101: 00010000:00010000:2.0:1787114846.149584:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114846.149599:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af042cb3600/0x194cd781e88c8286 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c827f expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114846.149636:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af042cb3600/0x194cd781e88c8286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c827f expref: 17 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114846.149646:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af042cb3600/0x194cd781e88c8286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c827f expref: 17 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114846.149655:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3600, rc 0) 00000100:00100000:2.0:1787114846.149693:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624582272:12345-0@lo:101: Request processed in 123us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114846.149700:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787114846.150684:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624582272:0@lo:101: 00010000:00010000:3.0:1787114846.150701:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af0429cbc00/0x194cd781e88c827f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8286 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114846.150725:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af0429cbc00/0x194cd781e88c827f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8286 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114846.150781:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624582400:0@lo:256: 00000100:00100000:3.0:1787114846.150820:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114846.150841:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04d4db3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787114846.151870:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624582400 00000100:00100000:2.0:1787114846.151881:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624582400 00000100:00100000:2.0:1787114846.151937:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787114846.151948:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624582400:12345-0@lo:256: 20000000:01000000:2.0:1787114846.151972:0:5779:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787114846.151989:0:5779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787114846.151992:0:5779:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787114846.152087:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624582400:12345-0@lo:256: Request processed in 141us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114846.152095:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787114846.153103:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624582400:0@lo:256: 10000000:01000000:3.0:1787114846.153189:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787114846.153198:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429cbc00/0x194cd781e88c827f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8286 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114846.153208:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af0429cbc00/0x194cd781e88c827f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8286 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787114846.153217:0:5782:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787114846.153220:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1787114846.153223:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787114846.153252:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c828d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114846.153261:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c828d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114846.153269:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c828d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114846.153286:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624582528:0@lo:101: 00000100:00100000:3.0:1787114846.153337:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114846.153380:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0438c9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787114846.153496:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624582528 00000100:00100000:2.0:1787114846.153501:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624582528 00000100:00100000:2.0:1787114846.153540:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787114846.153548:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624582528:12345-0@lo:101: 00010000:00010000:2.0:1787114846.153560:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114846.153573:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af042cb2400/0x194cd781e88c8294 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c828d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114846.153606:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af042cb2400/0x194cd781e88c8294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c828d expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114846.153615:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af042cb2400/0x194cd781e88c8294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c828d expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114846.153623:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2400, rc 0) 00000100:00100000:2.0:1787114846.153665:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624582528:12345-0@lo:101: Request processed in 118us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114846.153671:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787114846.154045:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624582528:0@lo:101: 00010000:00010000:1.0:1787114846.154060:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c828d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8294 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114846.154070:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c828d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8294 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114846.154143:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624582656:0@lo:501: 00000100:00100000:1.0:1787114846.154171:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114846.154187:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04303f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787114846.154200:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624582656 00000100:00100000:1.0:1787114846.154203:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624582656 00000100:00100000:1.0:1787114846.154232:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787114846.154239:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624582656:12345-0@lo:501: 00000100:00100000:1.0:1787114846.154498:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624582656:12345-0@lo:501: Request processed in 259us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114846.154514:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787114846.154543:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624582656:0@lo:501: 00000100:00100000:1.0:1787114846.154568:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624582784:0@lo:503: 00000100:00100000:1.0:1787114846.154600:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114846.154620:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624582784 00000100:00100000:2.0:1787114846.154624:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624582784 00000100:00100000:1.0:1787114846.154630:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04303f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787114846.154650:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787114846.154656:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624582784:12345-0@lo:503: 00000100:00100000:2.0:1787114846.156736:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624582784:12345-0@lo:503: Request processed in 2069us (2124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114846.156751:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787114846.157269:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624582784:0@lo:503: 00000100:00100000:0.0:1787114846.160358:0:7770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb94700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:7770:1873925624582912:0@lo:502: 00000100:00100000:0.0:1787114846.160454:0:7770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114846.160863:0:7770:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af05908e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787114846.160967:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624582912 00000100:00100000:1.0:1787114846.160975:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624582912 00000100:00100000:1.0:1787114846.161025:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787114846.161035:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:7770:x1873925624582912:12345-0@lo:502: 00000100:00100000:1.0:1787114846.165530:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:7770:x1873925624582912:12345-0@lo:502: Request processed in 4486us (5065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114846.165546:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787114846.165755:0:7770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb94700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:7770:1873925624582912:0@lo:502: 00000020:01000000:0.0:1787114846.165794:0:7770:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787114846.165801:0:7770:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787114846.165807:0:7770:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787114846.165817:0:7770:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787114846.165823:0:7770:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787114846.165827:0:7770:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.110@tcp to nid 0x20000c0a8ca6e (192.168.202.110@tcp) 00000020:01000000:0.0:1787114846.165858:0:7770:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787114846.165861:0:7770:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787114846.165939:0:7770:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8af042ccb380) 00000020:00000080:0.0:1787114846.165963:0:7770:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787114846.165970:0:7770:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787114846.166047:0:7770:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787114846.166053:0:7770:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787114846.166058:0:7770:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x194cd781e88c82a2 00010000:00080000:0.0:1787114846.166086:0:7770:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8af045130800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.110@tcp at head 00010000:00010000:0.0:1787114846.167202:0:7770:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787114846.170451:0:7770:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787114846.170483:0:7770:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787114846.172570:0:7770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787114846.174443:0:7770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787114846.174514:0:7770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787114846.174576:0:7770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787114846.177905:0:7773:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787114846.177914:0:7773:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787114846.186250:0:7770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787114846.186266:0:7770:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787114846.186303:0:7770:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787114846.186705:0:7770:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x194cd781e88c82a9 00000100:00080000:0.0:1787114846.186717:0:7770:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787114846.186724:0:7770:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8af045130800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1787114846.186763:0:7770:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af07fb94700 x1873925624583040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787114846.186796:0:7770:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1787114846.186939:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624583040:0@lo:8: 00000100:00100000:2.0:1787114846.187053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114846.187213:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624583040 00000100:00100000:2.0:1787114846.187220:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624583040 00000100:00100000:2.0:1787114846.187271:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787114846.187293:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1873925624583040:12345-0@lo:8: 00010000:00080000:2.0:1787114846.187349:0:6576:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:2.0:1787114846.187408:0:6576:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x194cd781e88c82b0 00002000:00100000:2.0:1787114846.187422:0:6576:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8af06f4bc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113803 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787114846.187448:0:6576:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787114846.187452:0:6576:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787114846.187612:0:6576:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787114846.187751:0:6576:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:0.0:1787114846.187763:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624583168:0@lo:400: 00000100:00080000:2.0:1787114846.187775:0:6576:0:(import.c:65:import_set_state_nolock()) ffff8af06f4ba800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787114846.187797:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114846.187867:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624583296:0@lo:400: 00000100:00100000:2.0:1787114846.190334:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1873925624583040:12345-0@lo:8: Request processed in 3032us (3280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114846.190348:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787114846.190433:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07fb94700 x1873925624583040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787114856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114846.190445:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787114846.190454:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787114846.190477:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787114846.190482:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787114846.190486:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af045130800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787114846.190515:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787114846.190521:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624583040:0@lo:8: 00000004:00080000:3.0:1787114846.193021:0:7773:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787114846.193236:0:7773:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 175179127774ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787114846.197779:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624583424:0@lo:400: 00000100:00100000:0.0:1787114846.197851:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114846.197921:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624583168 00000100:00100000:0.0:1787114846.197928:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624583168 00000100:00100000:0.0:1787114846.197975:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624583424 00000100:00100000:0.0:1787114846.197978:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624583424 00000100:00100000:0.0:1787114846.198001:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787114846.198010:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624583168:12345-0@lo:400: 00000100:00100000:0.0:1787114846.198065:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624583168:12345-0@lo:400: Request processed in 55us (10267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114846.198072:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787114846.198086:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787114846.198093:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624583424:12345-0@lo:400: 00000100:00100000:0.0:1787114846.198143:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624583424:12345-0@lo:400: Request processed in 50us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114846.198149:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787114846.198188:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07fb95500 x1873925624583424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787114862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114846.198203:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624583424:0@lo:400: 00010000:00080000:0.0:1787114846.198232:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07fb96a00 x1873925624583168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787114862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114846.198242:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624583168:0@lo:400: 00000020:01000000:0.0:1787114846.198309:0:7770:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787114846.198317:0:7770:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787114846.198319:0:7770:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787114846.198323:0:7770:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787114846.198328:0:7770:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787114846.198340:0:7770:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787114846.198345:0:7770:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787114846.198347:0:7770:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787114846.198379:0:7770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb96a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:7770:1873925624583552:0@lo:502: 00000100:00100000:0.0:1787114846.198423:0:7770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114846.198446:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624583552 00000100:00100000:0.0:1787114846.198450:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624583552 00000100:00100000:0.0:1787114846.198489:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787114846.198495:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:7770:x1873925624583552:12345-0@lo:502: 00000100:00100000:0.0:1787114846.198712:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:7770:x1873925624583552:12345-0@lo:502: Request processed in 217us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114846.198718:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787114846.198761:0:7770:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06c2dd300 going to sleep for 11 seconds 00000100:00100000:0.0:1787114846.198773:0:7770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb96a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:7770:1873925624583552:0@lo:502: 00000020:01000000:0.0:1787114846.198791:0:7770:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787114846.198795:0:7770:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787114846.198796:0:7770:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787114846.198800:0:7770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1787114846.198849:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787114846.198867:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787114846.198878:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c828d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8294 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114846.198889:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c828d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8294 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114846.198898:0:5782:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787114846.198901:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8af05916cd40 from 1 10000000:01000000:0.0:1787114846.198903:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787114846.198933:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052364800/0x194cd781e88c82b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114846.198940:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af052364800/0x194cd781e88c82b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114846.198948:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af052364800/0x194cd781e88c82b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114846.198960:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624583680:0@lo:101: 00000100:00100000:0.0:1787114846.198985:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114846.199004:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06c2dd300 going to sleep for 11 seconds 00000100:00100000:1.0:1787114846.199774:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624583680 00000100:00100000:1.0:1787114846.199782:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624583680 00000100:00100000:1.0:1787114846.199812:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787114846.199819:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624583680:12345-0@lo:101: 00010000:00010000:1.0:1787114846.199831:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787114846.199844:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af041682c00/0x194cd781e88c82be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c82b7 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114846.199869:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af041682c00/0x194cd781e88c82be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c82b7 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114846.199878:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af041682c00/0x194cd781e88c82be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c82b7 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114846.199898:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041682c00, rc 0) 00000100:00100000:1.0:1787114846.199939:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:5782:x1873925624583680:12345-0@lo:101: Request processed in 120us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114846.199944:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787114846.199981:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624583680:0@lo:101: 00010000:00010000:1.0:1787114846.199994:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af052364800/0x194cd781e88c82b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c82be expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114846.200003:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af052364800/0x194cd781e88c82b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c82be expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114846.200050:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624583808:0@lo:501: 00000100:00100000:1.0:1787114846.200075:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114846.200096:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04303f780 going to sleep for 11 seconds 00000100:00100000:1.0:1787114846.200122:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624583808 00000100:00100000:1.0:1787114846.200125:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624583808 00000100:00100000:1.0:1787114846.200145:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787114846.200150:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:5782:x1873925624583808:12345-0@lo:501: 00000100:00100000:1.0:1787114846.200310:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:5782:x1873925624583808:12345-0@lo:501: Request processed in 158us (233us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787114846.200317:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787114846.200344:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624583808:0@lo:501: 10000000:01000000:1.0:1787114846.200365:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787114846.200371:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052364800/0x194cd781e88c82b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c82be expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114846.200388:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af052364800/0x194cd781e88c82b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c82be expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114846.200421:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114846.200444:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624583296 00000100:00100000:1.0:1787114846.200448:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624583296 00000100:00100000:1.0:1787114846.200488:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787114846.200494:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624583296:12345-0@lo:400: 00000100:00100000:1.0:1787114846.200526:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624583296:12345-0@lo:400: Request processed in 33us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114846.200531:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787114846.200559:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07fb96680 x1873925624583296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787114862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114846.200569:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624583296:0@lo:400: 00000004:00080000:2.0:1787114846.297039:0:7774:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787114846.297069:0:7774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7774:1873925624584064:0@lo:7: 00000100:00100000:2.0:1787114846.297148:0:7774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114846.297765:0:7774:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051051600 going to sleep for 11 seconds 00000100:00100000:2.0:1787114846.297790:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624583936:0@lo:13: 00000100:00100000:2.0:1787114846.297822:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114846.298303:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624584064 00000100:00100000:2.0:1787114846.298755:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624584064 00000100:00100000:2.0:1787114846.298826:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787114846.298836:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7774:x1873925624584064:12345-0@lo:7: 00000100:00100000:2.0:1787114846.305168:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624583936 00000100:00100000:2.0:1787114846.305240:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624583936 00000100:00100000:2.0:1787114846.305305:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787114846.305316:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1873925624583936:12345-0@lo:13: 00002000:00000024:2.0:1787114846.305346:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787114846.305431:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1873925624583936:12345-0@lo:13: Request processed in 117us (7607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114846.305439:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787114846.305523:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787114846.305566:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af05125f800 x1873925624583936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114846.305589:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624583936:0@lo:13: 00002000:00080000:2.0:1787114846.305706:0:6577:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787114846.305712:0:6577:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787114846.305758:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7774:x1873925624584064:12345-0@lo:7: Request processed in 6923us (8609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114846.305765:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787114846.305786:0:7774:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af05125ed80 x1873925624584064/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787114862 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114846.305796:0:7774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7774:1873925624584064:0@lo:7: 00000004:00080000:0.0:1787114846.305808:0:7774:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787114846.305844:0:7774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb95500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7774:1873925624584192:0@lo:5: 00000100:00100000:0.0:1787114846.305881:0:7774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114846.305924:0:7774:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06c2dd300 going to sleep for 11 seconds 00000100:00100000:2.0:1787114846.306009:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624584192 00000100:00100000:2.0:1787114846.306013:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624584192 00000100:00100000:2.0:1787114846.306045:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787114846.306052:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7774:x1873925624584192:12345-0@lo:5: 00002000:00080000:2.0:1787114846.306071:0:6578:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787114846.306075:0:6578:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787114846.306530:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7774:x1873925624584192:12345-0@lo:5: Request processed in 477us (647us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787114846.306537:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787114846.308383:0:7774:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07fb95500 x1873925624584192/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787114862 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114846.308405:0:7774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb95500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7774:1873925624584192:0@lo:5: 00000004:00080000:1.0:1787114846.308419:0:7774:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787114846.308468:0:7774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cbb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7774:1873925624584320:0@lo:700: 00000100:00100000:1.0:1787114846.308519:0:7774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114846.308606:0:7774:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04303fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787114846.311756:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624584320 00000100:00100000:2.0:1787114846.311778:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624584320 00000100:00100000:2.0:1787114846.311833:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787114846.311843:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7774:x1873925624584320:12345-0@lo:700: 00000100:00100000:2.0:1787114846.312288:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6585:1873925624584448:0@lo:700: 00000100:00100000:2.0:1787114846.312361:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114846.312403:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051051e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787114846.313317:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624584448 00000100:00100000:1.0:1787114846.313326:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624584448 00000100:00100000:1.0:1787114846.313364:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787114846.313372:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6585:x1873925624584448:12345-0@lo:700: 00000004:00080000:0.0:1787114846.338612:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:1.0:1787114846.389593:0:5792:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1787114846.405010:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6585:x1873925624584448:12345-0@lo:700: Request processed in 91632us (92642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114846.405031:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787114846.405404:0:6585:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af05125f800 x1873925624584448/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787114862 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114846.405546:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6585:1873925624584448:0@lo:700: 40000000:02000000:1.0:1787114846.405561:0:6585:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:0.0:1787114846.410654:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787114846.480534:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1787114846.480553:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787114846.484218:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7774:x1873925624584320:12345-0@lo:700: Request processed in 172367us (175688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114846.484241:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787114846.484304:0:7774:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af042cbb100 x1873925624584320/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787114862 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114846.484316:0:7774:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787114846.484335:0:7774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cbb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7774:1873925624584320:0@lo:700: 00000004:02000040:2.0:1787114846.520590:0:7774:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1787114846.530894:0:7774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7774:1873925624584576:0@lo:5: 00000100:00100000:3.0:1787114846.530966:0:7774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114846.531024:0:7774:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051051540 going to sleep for 11 seconds 00000100:00100000:2.0:1787114846.532151:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624584576 00000100:00100000:2.0:1787114846.532162:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624584576 00000100:00100000:2.0:1787114846.532225:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787114846.532235:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7774:x1873925624584576:12345-0@lo:5: 00002000:00080000:3.0:1787114846.547182:0:6577:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787114846.547203:0:6577:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787114846.552737:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7774:x1873925624584576:12345-0@lo:5: Request processed in 20493us (21761us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787114846.552752:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787114846.553169:0:7774:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af0591d6680 x1873925624584576/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787114862 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114846.553191:0:7774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7774:1873925624584576:0@lo:5: 00000004:00080000:0.0:1787114846.553206:0:7774:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:0.0:1787114846.776844:0:7830:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg210-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787114847.435938:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114848.454224:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114849.478270:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114850.502436:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114851.207623:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624584704:0@lo:400: 00000100:00100000:0.0:1787114851.207694:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114851.207971:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624585216:0@lo:400: 00000100:00100000:0.0:1787114851.207999:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114851.208033:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787114851.208039:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624584832:0@lo:400: 00000100:00100000:0.0:1787114851.208059:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114851.208078:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624585344:0@lo:400: 00000100:00100000:0.0:1787114851.208099:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114851.208153:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624584960:0@lo:400: 00000100:00100000:0.0:1787114851.208174:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114851.208189:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624585472:0@lo:13: 00000100:00100000:0.0:1787114851.208207:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114851.208223:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787114851.208227:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624585088:0@lo:400: 00000100:00100000:0.0:1787114851.208265:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114851.208298:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624584704 00000100:00100000:0.0:1787114851.208306:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624584704 00000100:00100000:0.0:1787114851.208348:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787114851.208356:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624584704:12345-0@lo:400: 00000100:00100000:0.0:1787114851.208399:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624584704:12345-0@lo:400: Request processed in 43us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114851.208407:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787114851.208460:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624585216 00000100:00100000:0.0:1787114851.208464:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624585216 00000100:00100000:0.0:1787114851.208499:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624584832 00000100:00100000:0.0:1787114851.208501:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624584832 00000100:00100000:0.0:1787114851.208512:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624584960 00000100:00100000:0.0:1787114851.208514:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624584960 00000100:00100000:0.0:1787114851.208525:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787114851.208531:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624585216:12345-0@lo:400: 00000100:00100000:0.0:1787114851.208562:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624585216:12345-0@lo:400: Request processed in 31us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114851.208568:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787114851.208590:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787114851.208595:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624584832:12345-0@lo:400: 00000100:00100000:0.0:1787114851.208625:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624584832:12345-0@lo:400: Request processed in 30us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114851.208631:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787114851.208640:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787114851.208645:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624584960:12345-0@lo:400: 00000100:00100000:0.0:1787114851.208669:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624584960:12345-0@lo:400: Request processed in 25us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114851.208675:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787114851.208689:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624585344 00000100:00100000:0.0:1787114851.208692:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624585344 00000100:00100000:0.0:1787114851.208719:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624585088 00000100:00100000:1.0:1787114851.215237:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787114851.215265:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1873925624585344:12345-0@lo:400: 00000100:00100000:1.0:1787114851.215364:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1873925624585344:12345-0@lo:400: Request processed in 113us (7263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114851.215372:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787114851.215403:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624585472 00000100:00100000:1.0:1787114851.215420:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624585472 00000100:00100000:1.0:1787114851.215474:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787114851.215481:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624585472:12345-0@lo:13: 00002000:00000024:1.0:1787114851.215513:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787114851.215543:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624585472:12345-0@lo:13: Request processed in 63us (7335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114851.215549:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787114851.217050:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624585088 00010000:00080000:0.0:1787114851.217139:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07fb96d80 x1873925624584960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787114867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114851.217155:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624584960:0@lo:400: 00010000:00080000:0.0:1787114851.217188:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07fb96300 x1873925624585472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114851.217206:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624585472:0@lo:13: 00010000:00080000:0.0:1787114851.217249:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07fb94700 x1873925624584832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787114867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114851.217257:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624584832:0@lo:400: 00010000:00080000:0.0:1787114851.217267:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07fb97800 x1873925624585344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114851.217276:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624585344:0@lo:400: 00000100:00100000:0.0:1787114851.217285:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624584704:0@lo:400: 00010000:00080000:0.0:1787114851.217295:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07fb95180 x1873925624585216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787114867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114851.217301:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624585216:0@lo:400: 00000100:00100000:0.0:1787114851.217364:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787114851.217372:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c15a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624585088:12345-0@lo:400: 00000100:00100000:0.0:1787114851.217453:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c15a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624585088:12345-0@lo:400: Request processed in 82us (9187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114851.217459:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787114851.217482:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07fb97b80 x1873925624585088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114851.217491:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624585088:0@lo:400: 00000100:00080000:2.0:1787114851.218048:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787114851.218055:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787114851.218058:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787114851.526927:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114851.717608:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787114851.717633:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624585600:0@lo:13: 00000100:00100000:0.0:1787114851.717714:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114851.721552:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624585600 00000100:00100000:1.0:1787114851.721568:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624585600 00000100:00100000:1.0:1787114851.721631:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787114851.721640:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c15b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1873925624585600:12345-0@lo:13: 00002000:00000024:1.0:1787114851.721677:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787114851.721774:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c15b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1873925624585600:12345-0@lo:13: Request processed in 135us (4061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114851.721782:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787114851.725564:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af06c159180 x1873925624585600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114851.725648:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624585600:0@lo:13: 00000001:00080000:2.0:1787114851.809442:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1787114852.553669:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114853.259614:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114853.259775:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602541696 00000100:00100000:2.0:1787114853.259787:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602541696 00000100:00100000:2.0:1787114853.259868:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 110 00000100:00100000:2.0:1787114853.259877:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2360:x1873925602541696:12345-192.168.202.10@tcp:250: 00010000:00080000:2.0:1787114853.259906:0:5778:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from e19d3d13-0e41-457d-ab9f-79e10e5fe0d9@192.168.202.10@tcp t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:2.0:1787114853.260067:0:5778:0:(genops.c:1406:class_connect()) connect: client e19d3d13-0e41-457d-ab9f-79e10e5fe0d9, cookie 0x194cd781e88c82c5 00000100:00080000:2.0:1787114853.260248:0:5778:0:(import.c:65:import_set_state_nolock()) ffff8af06f4bd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787114853.260315:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+5:2360:x1873925602541696:12345-192.168.202.10@tcp:250: Request processed in 437us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114853.260324:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 110 00000100:00100000:1.0:1787114853.290052:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114853.290750:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602541824 00000100:00100000:3.0:1787114853.290764:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602541824 00000100:00100000:3.0:1787114853.290827:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 111 00000100:00100000:3.0:1787114853.290853:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+5:5565:x1873925602541824:12345-192.168.202.10@tcp:101: 00010000:00010000:3.0:1787114853.290871:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787114853.290889:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af0429cb000/0x194cd781e88c82cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1313 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114853.291077:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af0429cb000/0x194cd781e88c82cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1313 expref: 6 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114853.291093:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af0429cb000/0x194cd781e88c82cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1313 expref: 6 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114853.291103:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429cb000, rc 0) 00000100:00100000:3.0:1787114853.291195:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+6:5565:x1873925602541824:12345-192.168.202.10@tcp:101: Request processed in 344us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114853.291204:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 111 00000100:00100000:3.0:1787114853.297580:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114853.298865:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602541952 00000100:00100000:2.0:1787114853.298878:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602541952 00000100:00100000:2.0:1787114853.298970:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 112 00000100:00100000:2.0:1787114853.298981:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+6:5565:x1873925602541952:12345-192.168.202.10@tcp:501: 00000100:00100000:2.0:1787114853.299287:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+6:5565:x1873925602541952:12345-192.168.202.10@tcp:501: Request processed in 308us (1729us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787114853.299295:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 112 00000100:00100000:3.0:1787114853.302567:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114853.302678:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602542080 00000100:00100000:0.0:1787114853.302687:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602542080 00000100:00100000:0.0:1787114853.302736:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 113 00000100:00100000:0.0:1787114853.302744:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+6:5565:x1873925602542080:12345-192.168.202.10@tcp:101: 00010000:00010000:0.0:1787114853.302759:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114853.302776:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af052365200/0x194cd781e88c82d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d131a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114853.302803:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af052365200/0x194cd781e88c82d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d131a expref: 7 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114853.302813:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af052365200/0x194cd781e88c82d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d131a expref: 7 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114853.302822:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052365200, rc 0) 00000100:00100000:0.0:1787114853.302866:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+7:5565:x1873925602542080:12345-192.168.202.10@tcp:101: Request processed in 123us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114853.302872:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 113 00000100:00100000:0.0:1787114853.306175:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114853.306341:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602542208 00000100:00100000:3.0:1787114853.306351:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602542208 00000100:00100000:3.0:1787114853.306457:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 114 00000100:00100000:3.0:1787114853.306467:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+7:5565:x1873925602542208:12345-192.168.202.10@tcp:501: 00000100:00100000:3.0:1787114853.306748:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+8:5565:x1873925602542208:12345-192.168.202.10@tcp:501: Request processed in 280us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114853.306757:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 114 00000100:00100000:0.0:1787114853.312054:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114853.312578:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602542336 00000100:00100000:2.0:1787114853.312589:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602542336 00000100:00100000:2.0:1787114853.312643:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 115 00000100:00100000:2.0:1787114853.312654:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+8:5565:x1873925602542336:12345-192.168.202.10@tcp:503: 00000100:00100000:2.0:1787114853.312937:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+8:5565:x1873925602542336:12345-192.168.202.10@tcp:503: Request processed in 283us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114853.312946:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 115 00000100:00100000:1.0:1787114853.322196:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114853.322259:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602542464 00000100:00100000:3.0:1787114853.322269:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602542464 00000100:00100000:3.0:1787114853.322325:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 116 00000100:00100000:3.0:1787114853.322336:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+8:5584:x1873925602542464:12345-192.168.202.10@tcp:502: 00000100:00100000:3.0:1787114853.322686:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+8:5584:x1873925602542464:12345-192.168.202.10@tcp:502: Request processed in 350us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114853.322695:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 116 00000100:00100000:0.0:1787114853.358896:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114853.359015:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602542592 00000100:00100000:3.0:1787114853.359028:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602542592 00000100:00100000:3.0:1787114853.359100:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 117 00000100:00100000:3.0:1787114853.359138:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+8:5584:x1873925602542592:12345-192.168.202.10@tcp:502: 00000100:00100000:3.0:1787114853.359467:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+8:5584:x1873925602542592:12345-192.168.202.10@tcp:502: Request processed in 357us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114853.359476:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 117 00000100:00100000:3.0:1787114853.362908:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114853.363008:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602542720 00000100:00100000:2.0:1787114853.363019:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602542720 00000100:00100000:2.0:1787114853.363068:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 118 00000100:00100000:2.0:1787114853.363076:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+8:5565:x1873925602542720:12345-192.168.202.10@tcp:101: 00010000:00010000:2.0:1787114853.363091:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114853.363104:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af042cb3400/0x194cd781e88c82da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1344 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114853.363142:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af042cb3400/0x194cd781e88c82da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1344 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114853.363150:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af042cb3400/0x194cd781e88c82da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1344 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114853.363157:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3400, rc 0) 00000100:00100000:2.0:1787114853.363220:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+9:5565:x1873925602542720:12345-192.168.202.10@tcp:101: Request processed in 146us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114853.363226:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 118 00000100:00100000:1.0:1787114853.365938:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114853.366057:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602542848 00000100:00100000:0.0:1787114853.366066:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602542848 00000100:00100000:0.0:1787114853.366134:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 119 00000100:00100000:0.0:1787114853.366143:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+9:5565:x1873925602542848:12345-192.168.202.10@tcp:256: 20000000:01000000:0.0:1787114853.366167:0:5780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787114853.366195:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787114853.366200:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787114853.366203:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787114853.366205:0:5780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787114853.368462:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+9:5565:x1873925602542848:12345-192.168.202.10@tcp:256: Request processed in 2308us (2520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114853.368475:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 119 00000100:00100000:2.0:1787114853.372586:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114853.373937:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602542976 00000100:00100000:3.0:1787114853.373950:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602542976 00000100:00100000:3.0:1787114853.374010:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 120 00000100:00100000:3.0:1787114853.374020:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+9:5565:x1873925602542976:12345-192.168.202.10@tcp:101: 00010000:00010000:3.0:1787114853.374040:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787114853.374058:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af0429cba00/0x194cd781e88c82e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d134b expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114853.374086:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af0429cba00/0x194cd781e88c82e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d134b expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114853.374095:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af0429cba00/0x194cd781e88c82e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d134b expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114853.374143:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429cba00, rc 0) 00000100:00100000:3.0:1787114853.374210:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:5565:x1873925602542976:12345-192.168.202.10@tcp:101: Request processed in 190us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114853.374218:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 120 00000100:00100000:0.0:1787114853.386687:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114853.386845:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602543104 00000100:00100000:3.0:1787114853.386856:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602543104 00000100:00100000:3.0:1787114853.386908:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 121 00000100:00100000:3.0:1787114853.386919:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:5565:x1873925602543104:12345-192.168.202.10@tcp:501: 00000100:00100000:3.0:1787114853.387234:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:5565:x1873925602543104:12345-192.168.202.10@tcp:501: Request processed in 316us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114853.387243:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 121 00000100:00100000:0.0:1787114853.405036:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114853.405144:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602543232 00000100:00100000:2.0:1787114853.405155:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602543232 00000100:00100000:2.0:1787114853.405198:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 122 00000100:00100000:2.0:1787114853.405207:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:5565:x1873925602543232:12345-192.168.202.10@tcp:503: 00000100:00100000:2.0:1787114853.405750:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:5565:x1873925602543232:12345-192.168.202.10@tcp:503: Request processed in 542us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114853.405759:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 122 00000100:00100000:0.0:1787114853.413039:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114853.413150:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602543360 00000100:00100000:3.0:1787114853.413161:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602543360 00000100:00100000:3.0:1787114853.413219:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 123 00000100:00100000:3.0:1787114853.413229:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:5589:x1873925602543360:12345-192.168.202.10@tcp:502: 00000100:00100000:3.0:1787114853.414032:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:5589:x1873925602543360:12345-192.168.202.10@tcp:502: Request processed in 801us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114853.414043:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 123 00000100:00100000:0.0:1787114853.421569:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114853.421661:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602543488 00000100:00100000:1.0:1787114853.421674:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602543488 00000100:00100000:1.0:1787114853.421726:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 124 00000100:00100000:1.0:1787114853.421735:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:5589:x1873925602543488:12345-192.168.202.10@tcp:502: 00000100:00100000:1.0:1787114853.421950:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:5589:x1873925602543488:12345-192.168.202.10@tcp:502: Request processed in 215us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114853.421959:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 124 00000100:00100000:1.0:1787114853.428662:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114853.429014:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602543616 00000100:00100000:0.0:1787114853.429024:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602543616 00000100:00100000:0.0:1787114853.429073:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4 00000100:00100000:0.0:1787114853.429081:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1873925602543616:12345-192.168.202.10@tcp:38: 00010000:00080000:0.0:1787114853.429140:0:5786:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:0.0:1787114853.429184:0:5786:0:(genops.c:1406:class_connect()) connect: client 6aef9ffe-3b7b-498c-9a5a-a012c6970297, cookie 0x194cd781e88c82e8 00000004:00100000:0.0:1787114853.429212:0:5786:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787114853.429218:0:5786:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787114853.482993:0:5786:0:(import.c:65:import_set_state_nolock()) ffff8af045137000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787114853.483336:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2360:x1873925602543616:12345-192.168.202.10@tcp:38: Request processed in 54253us (54683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114853.483344:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4 00010000:00010000:0.0:1787114853.575962:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114854.496075:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114854.496195:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114854.496309:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602543872 00000100:00100000:1.0:1787114854.496322:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602543872 00000100:00100000:1.0:1787114854.496566:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602543744 00000100:00100000:1.0:1787114854.496571:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602543744 00000100:00100000:1.0:1787114854.496598:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5 00000100:00100000:1.0:1787114854.496609:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:5565:x1873925602543872:12345-192.168.202.10@tcp:41: 00000004:00000024:1.0:1787114854.496670:0:7216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787114854.496762:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:5565:x1873925602543872:12345-192.168.202.10@tcp:41: Request processed in 154us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114854.496771:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5 00000100:00100000:1.0:1787114854.496791:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00100000:1.0:1787114854.496798:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c15bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:0:x1873925602543744:12345-192.168.202.10@tcp:41: 00000004:00000024:1.0:1787114854.496810:0:7216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787114854.496842:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c15bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:0:x1873925602543744:12345-192.168.202.10@tcp:41: Request processed in 44us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114854.496848:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00080000:3.0:1787114854.497100:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787114854.501675:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114854.502398:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602544000 00000100:00100000:1.0:1787114854.502415:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602544000 00000100:00100000:1.0:1787114854.502488:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:1.0:1787114854.502498:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:5565:x1873925602544000:12345-192.168.202.10@tcp:40: 00000100:00100000:1.0:1787114854.502653:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:5565:x1873925602544000:12345-192.168.202.10@tcp:40: Request processed in 155us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114854.502661:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:1.0:1787114854.517824:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114854.517949:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114854.517982:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114854.518029:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114854.518360:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602544128 00000100:00100000:2.0:1787114854.518370:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602544128 00000100:00100000:2.0:1787114854.518431:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602544256 00000100:00100000:2.0:1787114854.518435:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602544256 00000100:00100000:2.0:1787114854.518450:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:2.0:1787114854.518457:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1873925602544128:12345-192.168.202.10@tcp:8: 00010000:00080000:2.0:1787114854.518487:0:6576:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:2.0:1787114854.518521:0:6576:0:(genops.c:1406:class_connect()) connect: client 6aef9ffe-3b7b-498c-9a5a-a012c6970297, cookie 0x194cd781e88c82ef 00002000:00100000:2.0:1787114854.518535:0:6576:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6aef9ffe-3b7b-498c-9a5a-a012c6970297/ffff8af06f4b8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113803 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787114854.518569:0:6576:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787114854.519169:0:6576:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787114854.519200:0:6576:0:(import.c:65:import_set_state_nolock()) ffff8af06f4bb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787114854.519270:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2360:x1873925602544128:12345-192.168.202.10@tcp:8: Request processed in 811us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114854.519278:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:2.0:1787114854.519313:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00100000:2.0:1787114854.519318:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1873925602544256:12345-192.168.202.10@tcp:8: 00010000:00080000:2.0:1787114854.519335:0:6576:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:2.0:1787114854.519355:0:6576:0:(genops.c:1406:class_connect()) connect: client 6aef9ffe-3b7b-498c-9a5a-a012c6970297, cookie 0x194cd781e88c82f6 00002000:00100000:2.0:1787114854.519361:0:6576:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6aef9ffe-3b7b-498c-9a5a-a012c6970297/ffff8af06f4b9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113803 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787114854.519375:0:6576:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787114854.520173:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602544512 00000100:00100000:0.0:1787114854.520183:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602544512 00000100:00100000:0.0:1787114854.520227:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 125 00000100:00100000:0.0:1787114854.520235:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2362:x1873925602544512:12345-192.168.202.10@tcp:400: 00000100:00100000:0.0:1787114854.520279:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2362:x1873925602544512:12345-192.168.202.10@tcp:400: Request processed in 44us (2250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114854.520285:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 125 00002000:00080000:2.0:1787114854.520754:0:6576:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787114854.521757:0:6576:0:(import.c:65:import_set_state_nolock()) ffff8af06f4be000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787114854.522296:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2360:x1873925602544256:12345-192.168.202.10@tcp:8: Request processed in 2973us (4309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114854.522306:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00100000:3.0:1787114854.529444:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602544384 00000100:00100000:3.0:1787114854.529461:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602544384 00000100:00100000:3.0:1787114854.530776:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:3.0:1787114854.530794:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:5565:x1873925602544384:12345-192.168.202.10@tcp:33: 00000004:00080000:3.0:1787114854.582312:0:5788:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 51439us 00000004:00200000:0.0:1787114854.596031:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787114854.596267:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:5565:x1873925602544384:12345-192.168.202.10@tcp:33: Request processed in 65472us (78499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114854.596283:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 0 00010000:00010000:2.0:1787114854.602171:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114854.908100:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114854.908413:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602544640 00000100:00100000:3.0:1787114854.908433:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602544640 00000100:00100000:3.0:1787114854.908501:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:3.0:1787114854.908512:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c15ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:5606:x1873925602544640:12345-192.168.202.10@tcp:101: 00010000:00010000:3.0:1787114854.908534:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787114854.908584:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cb200/0x194cd781e88c82fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1375 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114854.908646:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8304 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114854.908660:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8304 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114854.908674:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8304 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787114854.908912:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787114854.908917:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787114854.908994:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8304 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114854.909035:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cb200/0x194cd781e88c82fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1375 expref: 8 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114854.909054:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8304 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1375 expref: 7 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114854.909062:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af044d99e00) 00010000:00010000:3.0:1787114854.909065:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787114854.909076:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429ca000, rc 0) 00000100:00100000:3.0:1787114854.909221:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c15ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:5606:x1873925602544640:12345-192.168.202.10@tcp:101: Request processed in 711us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114854.909228:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8 00000001:00100000:1.0:1787114855.344556:0:6604:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6aef9ffe-3b7b-498c-9a5a-a012c6970297 00010000:00010000:0.0:1787114855.621516:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114856.325394:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787114856.325422:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624585728:0@lo:13: 00000100:00100000:2.0:1787114856.325987:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624586112:0@lo:400: 00000100:00100000:1.0:1787114856.326053:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624586240:0@lo:400: 00000100:00100000:3.0:1787114856.327297:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624585984:0@lo:400: 00000100:00100000:3.0:1787114856.327380:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114856.327438:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624586496:0@lo:400: 00000100:00100000:3.0:1787114856.327468:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114856.327534:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624586496 00000100:00100000:3.0:1787114856.327543:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624586496 00000100:00100000:3.0:1787114856.327742:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787114856.327754:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624586496:12345-0@lo:400: 00000100:00100000:3.0:1787114856.327822:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624586496:12345-0@lo:400: Request processed in 71us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114856.327829:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787114856.327850:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787114856.327878:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af05125dc00 x1873925624586496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114856.327889:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787114856.327906:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624586496:0@lo:400: 00000100:00100000:3.0:1787114856.327942:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624585984 00000100:00100000:3.0:1787114856.327946:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624585984 00000100:00100000:3.0:1787114856.327973:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787114856.327979:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624585984:12345-0@lo:400: 00000100:00100000:3.0:1787114856.328155:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624585984:12345-0@lo:400: Request processed in 175us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114856.328162:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787114856.328209:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624585984:0@lo:400: 00000100:00100000:0.0:1787114856.330377:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114856.330448:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624585856:0@lo:400: 00000100:00100000:0.0:1787114856.330496:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114856.331681:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624585728 00000100:00100000:3.0:1787114856.331695:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624585728 00000100:00100000:3.0:1787114856.331769:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787114856.331778:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624585728:12345-0@lo:13: 00002000:00000024:3.0:1787114856.331818:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787114856.331880:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624585728:12345-0@lo:13: Request processed in 102us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114856.331901:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787114856.331926:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787114856.331961:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624585856 00000100:00100000:3.0:1787114856.331965:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624585856 00000100:00100000:3.0:1787114856.331993:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787114856.332009:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624585856:12345-0@lo:400: 00000100:00100000:3.0:1787114856.332041:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624585856:12345-0@lo:400: Request processed in 42us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114856.332048:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787114856.332672:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624585856:0@lo:400: 00000100:00100000:0.0:1787114856.332684:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624586368:0@lo:400: 00000100:00100000:0.0:1787114856.332726:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787114856.332759:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af06c15b800 x1873925624585728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114856.332775:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624585728:0@lo:13: 00000100:00100000:2.0:1787114856.332879:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114856.333039:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624586368 00000100:00100000:0.0:1787114856.333059:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624586368 00000100:00100000:0.0:1787114856.333103:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624586112 00000100:00100000:0.0:1787114856.333126:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624586112 00000100:00100000:0.0:1787114856.333148:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787114856.333154:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624586368:12345-0@lo:400: 00000100:00100000:0.0:1787114856.333321:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624586368:12345-0@lo:400: Request processed in 166us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114856.333328:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787114856.333343:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787114856.333350:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624586112:12345-0@lo:400: 00000100:00100000:0.0:1787114856.333392:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624586112:12345-0@lo:400: Request processed in 42us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114856.333398:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787114856.333432:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624586368:0@lo:400: 00000100:00080000:2.0:1787114856.333615:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787114856.333638:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624586112:0@lo:400: 00000100:00100000:1.0:1787114856.334445:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114856.338681:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624586240 00000100:00100000:3.0:1787114856.338699:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624586240 00000100:00100000:3.0:1787114856.338780:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787114856.338790:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624586240:12345-0@lo:400: 00000100:00100000:3.0:1787114856.338976:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624586240:12345-0@lo:400: Request processed in 187us (4531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114856.338983:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787114856.346079:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af05125ea00 x1873925624586240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114856.346126:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624586240:0@lo:400: 00010000:00010000:2.0:1787114856.646184:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787114856.837453:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787114856.837484:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624586624:0@lo:13: 00000100:00100000:3.0:1787114856.837563:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114856.838096:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624586624 00000100:00100000:1.0:1787114856.838104:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624586624 00000100:00100000:1.0:1787114856.838202:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787114856.838213:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624586624:12345-0@lo:13: 00002000:00000024:1.0:1787114856.838251:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787114856.838315:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624586624:12345-0@lo:13: Request processed in 104us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114856.838331:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787114856.838506:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af06c15b800 x1873925624586624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114856.838537:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624586624:0@lo:13: 00000100:00100000:0.0:1787114857.243570:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114857.248454:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602544768 00000100:00100000:2.0:1787114857.248481:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602544768 00000100:00100000:2.0:1787114857.248577:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00100000:2.0:1787114857.248587:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c15b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:5658:x1873925602544768:12345-192.168.202.10@tcp:41: 00000004:00000024:2.0:1787114857.248889:0:5785:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787114857.248998:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c15b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:5658:x1873925602544768:12345-192.168.202.10@tcp:41: Request processed in 410us (5437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114857.249005:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00080000:3.0:1787114857.249140:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787114857.260870:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114857.260967:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602544896 00000100:00100000:3.0:1787114857.260978:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602544896 00000100:00100000:3.0:1787114857.261060:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 10 00000100:00100000:3.0:1787114857.261071:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:5658:x1873925602544896:12345-192.168.202.10@tcp:13: 00002000:00000024:3.0:1787114857.261098:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787114857.261197:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:5658:x1873925602544896:12345-192.168.202.10@tcp:13: Request processed in 127us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114857.261206:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 10 00000100:00080000:2.0:1787114857.261278:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787114857.267802:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114857.267962:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602545024 00000100:00100000:3.0:1787114857.267973:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602545024 00000100:00100000:3.0:1787114857.268193:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00100000:3.0:1787114857.268204:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:5658:x1873925602545024:12345-192.168.202.10@tcp:13: 00002000:00000024:3.0:1787114857.268230:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787114857.268292:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:5658:x1873925602545024:12345-192.168.202.10@tcp:13: Request processed in 89us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114857.268299:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00080000:2.0:1787114857.269431:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787114857.669780:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114858.698325:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787114859.007554:0:5807:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6aef9ffe-3b7b-498c-9a5a-a012c6970297 00000001:00100000:2.0:1787114859.090596:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6aef9ffe-3b7b-498c-9a5a-a012c6970297 00010000:00010000:0.0:1787114859.719035:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114859.923363:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114859.923413:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114859.923426:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602545152 00000100:00100000:2.0:1787114859.923443:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602545152 00000100:00100000:1.0:1787114859.923464:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114859.923492:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 127 00000100:00100000:2.0:1787114859.923503:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2361:x1873925602545152:12345-192.168.202.10@tcp:400: 00000100:00100000:0.0:1787114859.923519:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602545280 00000100:00100000:0.0:1787114859.923523:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602545280 00000100:00100000:0.0:1787114859.923582:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 23 00000100:00100000:2.0:1787114859.923585:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2361:x1873925602545152:12345-192.168.202.10@tcp:400: Request processed in 84us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114859.923591:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2361:x1873925602545280:12345-192.168.202.10@tcp:400: 00000100:00100000:2.0:1787114859.923594:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 127 00000100:00100000:3.0:1787114859.923597:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602545408 00000100:00100000:3.0:1787114859.923605:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602545408 00000100:00100000:0.0:1787114859.923623:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2361:x1873925602545280:12345-192.168.202.10@tcp:400: Request processed in 34us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114859.923631:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 23 00000100:00080000:0.0:1787114859.923650:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787114859.923655:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787114859.923664:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:3.0:1787114859.923678:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2361:x1873925602545408:12345-192.168.202.10@tcp:400: 00000100:00100000:3.0:1787114859.923734:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2361:x1873925602545408:12345-192.168.202.10@tcp:400: Request processed in 60us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114859.923741:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:1.0:1787114859.923990:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114859.924041:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602545536 00000100:00100000:0.0:1787114859.924046:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602545536 00000100:00100000:0.0:1787114859.924079:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00100000:0.0:1787114859.924087:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2361:x1873925602545536:12345-192.168.202.10@tcp:400: 00000100:00080000:1.0:1787114859.924287:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787114859.924401:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2361:x1873925602545536:12345-192.168.202.10@tcp:400: Request processed in 313us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114859.924408:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 9 00000001:02000400:1.0:1787114860.319502:0:8137:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787114860.741404:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114861.446056:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624586752:0@lo:13: 00000100:00100000:1.0:1787114861.446176:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114861.446338:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624586752 00000100:00100000:3.0:1787114861.446347:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624586752 00000100:00100000:3.0:1787114861.446409:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787114861.446433:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624586752:12345-0@lo:13: 00002000:00000024:3.0:1787114861.446472:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787114861.446532:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624586752:12345-0@lo:13: Request processed in 100us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114861.446539:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1787114861.446886:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787114861.446918:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af06c158e00 x1873925624586752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114861.446938:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624586752:0@lo:13: 00000100:00100000:3.0:1787114861.448551:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624587264:0@lo:400: 00000100:00100000:3.0:1787114861.448604:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114861.448654:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787114861.448661:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624586880:0@lo:400: 00000100:00100000:3.0:1787114861.448688:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114861.448709:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624587392:0@lo:400: 00000100:00100000:3.0:1787114861.448732:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114861.448760:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624586880 00000100:00100000:3.0:1787114861.448765:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624586880 00000100:00100000:3.0:1787114861.448800:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787114861.448808:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624586880:12345-0@lo:400: 00000100:00100000:3.0:1787114861.448850:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624586880:12345-0@lo:400: Request processed in 42us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114861.448857:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787114861.448888:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624587392 00000100:00100000:3.0:1787114861.448892:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624587392 00000100:00100000:3.0:1787114861.448922:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787114861.448929:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624587392:12345-0@lo:400: 00000100:00100000:3.0:1787114861.448960:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624587392:12345-0@lo:400: Request processed in 32us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114861.448965:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787114861.449010:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624586880:0@lo:400: 00010000:00080000:3.0:1787114861.449023:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af073aece00 x1873925624587392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114861.449033:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624587392:0@lo:400: 00000100:00100000:2.0:1787114861.449242:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624587136:0@lo:400: 00000100:00100000:2.0:1787114861.449274:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114861.449299:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787114861.449305:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624587008:0@lo:400: 00000100:00100000:2.0:1787114861.449341:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114861.449373:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624587264 00000100:00100000:2.0:1787114861.449377:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624587264 00000100:00100000:2.0:1787114861.449403:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624587136 00000100:00100000:2.0:1787114861.449406:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624587136 00000100:00100000:2.0:1787114861.449418:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624587008 00000100:00100000:2.0:1787114861.449427:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624587008 00000100:00100000:2.0:1787114861.449444:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787114861.449451:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624587264:12345-0@lo:400: 00000100:00100000:2.0:1787114861.449503:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624587264:12345-0@lo:400: Request processed in 53us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114861.449510:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787114861.449524:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787114861.449530:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624587136:12345-0@lo:400: 00000100:00100000:2.0:1787114861.449561:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624587136:12345-0@lo:400: Request processed in 31us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114861.449567:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787114861.449579:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787114861.449586:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624587008:12345-0@lo:400: 00000100:00100000:2.0:1787114861.449612:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624587008:12345-0@lo:400: Request processed in 27us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114861.449617:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787114861.449645:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624587008:0@lo:400: 00000100:00100000:2.0:1787114861.449656:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624587136:0@lo:400: 00000100:00100000:2.0:1787114861.449684:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624587264:0@lo:400: 00000100:00080000:1.0:1787114861.449815:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787114861.449821:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787114861.765408:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114861.957378:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624587520:0@lo:13: 00000100:00100000:2.0:1787114861.957507:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114861.957784:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624587520 00000100:00100000:0.0:1787114861.957803:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624587520 00000100:00100000:0.0:1787114861.957893:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787114861.957903:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624587520:12345-0@lo:13: 00002000:00000024:0.0:1787114861.957962:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787114861.958054:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624587520:12345-0@lo:13: Request processed in 152us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114861.958081:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787114861.958153:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af06c158700 x1873925624587520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114861.958170:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624587520:0@lo:13: 00010000:00010000:2.0:1787114862.811497:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114863.813900:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787114864.523820:0:8285:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd217a1b10 20000000:00000080:3.0:1787114864.523845:0:8285:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8af0739b4c00 uarg=0000000000000000 20000000:01000000:3.0:1787114864.523887:0:8285:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787114864.523891:0:8285:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787114864.523894:0:8285:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787114864.523898:0:8285:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787114864.523902:0:8285:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787114864.523916:0:8285:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787114864.523919:0:8285:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787114864.525771:0:8285:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787114864.525778:0:8285:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787114864.527824:0:8286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1787114864.531889:0:8285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1787114864.531950:0:8285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1787114864.531990:0:8285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1787114864.532007:0:8285:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787114864.532010:0:8285:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787114864.533768:0:8287:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1787114864.534379:0:8285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1787114864.534443:0:8285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1787114864.535639:0:8285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1787114864.535660:0:8285:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787114864.535662:0:8285:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787114864.536851:0:8288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1787114864.537271:0:8285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1787114864.537330:0:8285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1787114864.537382:0:8285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1787114864.537393:0:8285:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787114864.537395:0:8285:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787114864.538940:0:8289:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787114864.540620:0:8285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787114864.540699:0:8285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1787114864.540811:0:8285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:3.0:1787114864.540827:0:8285:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787114864.540846:0:8285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8af0429cb200/0x194cd781e88c830b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.540864:0:8285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af041682600/0x194cd781e88c8208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8201 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.540871:0:8285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af042cb2c00/0x194cd781e88c8232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c822b expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.540878:0:8285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af042cb3c00/0x194cd781e88c825c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8255 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.540886:0:8285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af0429ca800/0x194cd781e88c826a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8263 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.540893:0:8285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af0429cb400/0x194cd781e88c8278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8271 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.540900:0:8285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af042cb2400/0x194cd781e88c8294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c828d expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.540908:0:8285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af041682c00/0x194cd781e88c82be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c82b7 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.540917:0:8285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af0429cb000/0x194cd781e88c82cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1313 expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.540925:0:8285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af052365200/0x194cd781e88c82d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d131a expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.540943:0:8285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8af0429cb200/0x194cd781e88c830b lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.540983:0:8285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af052365200/0x194cd781e88c82d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d131a expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.541001:0:8285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af052365200/0x194cd781e88c82d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d131a expref: 9 pid: 5780 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114864.541016:0:8285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8285:1873925624587648:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787114864.542634:0:8285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af0429cb000/0x194cd781e88c82cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1313 expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.542650:0:8285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af0429cb000/0x194cd781e88c82cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1313 expref: 9 pid: 5780 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114864.542661:0:8285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8285:1873925624587776:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787114864.542732:0:8285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af041682c00/0x194cd781e88c82be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c82b7 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.542740:0:8285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af041682c00/0x194cd781e88c82be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c82b7 expref: 18 pid: 5778 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114864.542750:0:8285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8285:1873925624587904:0@lo:104: 00000100:00100000:3.0:1787114864.542788:0:8285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787114864.542834:0:8285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af042cb2400/0x194cd781e88c8294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c828d expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.542858:0:8285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af042cb2400/0x194cd781e88c8294 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c828d expref: 18 pid: 5780 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114864.542867:0:8285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8285:1873925624588032:0@lo:104: 00000100:00100000:3.0:1787114864.542896:0:8285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787114864.542921:0:8285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af0429cb400/0x194cd781e88c8278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c8271 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.542929:0:8285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af0429cb400/0x194cd781e88c8278 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c8271 expref: 18 pid: 5780 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114864.542936:0:8285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8285:1873925624588160:0@lo:104: 00010000:00010000:3.0:1787114864.542971:0:8285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af0429ca800/0x194cd781e88c826a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c8263 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.542978:0:8285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af0429ca800/0x194cd781e88c826a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c8263 expref: 18 pid: 5780 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114864.542986:0:8285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8285:1873925624588288:0@lo:104: 00010000:00010000:3.0:1787114864.543007:0:8285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af042cb3c00/0x194cd781e88c825c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c8255 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.543015:0:8285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af042cb3c00/0x194cd781e88c825c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c8255 expref: 18 pid: 5780 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114864.543023:0:8285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb71180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8285:1873925624588416:0@lo:104: 00010000:00010000:3.0:1787114864.543045:0:8285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af042cb2c00/0x194cd781e88c8232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c822b expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.543063:0:8285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af042cb2c00/0x194cd781e88c8232 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c822b expref: 18 pid: 5779 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114864.543071:0:8285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb73480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8285:1873925624588544:0@lo:104: 00010000:00010000:3.0:1787114864.543097:0:8285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af041682600/0x194cd781e88c8208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c8201 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.543127:0:8285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af041682600/0x194cd781e88c8208 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c8201 expref: 18 pid: 5779 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114864.543137:0:8285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb73b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8285:1873925624588672:0@lo:104: 00000100:00100000:3.0:1787114864.543157:0:8285:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af07b8e1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787114864.543590:0:5768:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787114864.543609:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114864.543621:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114864.543630:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114864.543638:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114864.543646:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114864.543653:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624587904 00000100:00100000:1.0:1787114864.543659:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624587904 00000100:00100000:1.0:1787114864.543696:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624588032 00000100:00100000:1.0:1787114864.543718:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624588032 00000100:00100000:1.0:1787114864.543734:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624588160 00000100:00100000:1.0:1787114864.543737:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624588160 00000100:00100000:1.0:1787114864.543746:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624588288 00000100:00100000:1.0:1787114864.543748:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624588288 00000100:00100000:1.0:1787114864.543756:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624588416 00000100:00100000:1.0:1787114864.543758:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624588416 00000100:00100000:1.0:1787114864.543765:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624588544 00000100:00100000:1.0:1787114864.543767:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624588544 00000100:00100000:1.0:1787114864.543775:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624588672 00000100:00100000:1.0:1787114864.543777:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624588672 00000100:00100000:1.0:1787114864.543789:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787114864.543797:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+9:8285:x1873925624587904:12345-0@lo:104: 00010000:00010000:1.0:1787114864.543810:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af052364800/0x194cd781e88c82b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c82be expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.543858:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787114864.543865:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+9:8285:x1873925624587904:12345-0@lo:104: Request processed in 69us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114864.543872:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787114864.543888:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787114864.543894:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06e91a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+8:8285:x1873925624588032:12345-0@lo:104: 00010000:00010000:1.0:1787114864.543901:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c828d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8294 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.543936:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787114864.543942:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06e91a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+8:8285:x1873925624588032:12345-0@lo:104: Request processed in 49us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114864.543947:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787114864.543978:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787114864.543990:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+7:8285:x1873925624588160:12345-0@lo:104: 00010000:00010000:1.0:1787114864.543998:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af052365000/0x194cd781e88c8271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8278 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.544026:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787114864.544030:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+7:8285:x1873925624588160:12345-0@lo:104: Request processed in 42us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114864.544036:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787114864.544048:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787114864.544054:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+6:8285:x1873925624588288:12345-0@lo:104: 00010000:00010000:1.0:1787114864.544061:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c8263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c826a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.544085:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787114864.544090:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+6:8285:x1873925624588288:12345-0@lo:104: Request processed in 37us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114864.544096:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787114864.544135:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787114864.544143:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+5:8285:x1873925624588416:12345-0@lo:104: 00010000:00010000:1.0:1787114864.544150:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c825c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.544176:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787114864.544180:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+5:8285:x1873925624588416:12345-0@lo:104: Request processed in 40us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114864.544185:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787114864.544196:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787114864.544208:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+4:8285:x1873925624588544:12345-0@lo:104: 00010000:00010000:1.0:1787114864.544216:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c822b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8232 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.544241:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787114864.544246:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+4:8285:x1873925624588544:12345-0@lo:104: Request processed in 39us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114864.544252:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787114864.544264:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787114864.544269:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:8285:x1873925624588672:12345-0@lo:104: 00010000:00010000:1.0:1787114864.544277:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c8201 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8208 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.544311:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1787114864.544316:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:8285:x1873925624588672:12345-0@lo:104: Request processed in 47us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114864.544321:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787114864.544339:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787114864.544344:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af052364800/0x194cd781e88c82b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c82be expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.544351:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364800 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1787114864.544355:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af052364800/0x194cd781e88c82b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c82be expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.544364:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af052364800/0x194cd781e88c82b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c82be expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787114864.544371:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af052364800/0x194cd781e88c82b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c82be expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787114864.544383:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787114864.544412:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af052364800/0x194cd781e88c82b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c82be expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.544418:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787114864.544435:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af052364800/0x194cd781e88c82b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c82be expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.544442:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af052364800/0x194cd781e88c82b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c82be expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.544456:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787114864.544459:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c828d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8294 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.544465:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429ca200 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1787114864.544467:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c828d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c8294 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.544474:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c828d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c8294 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787114864.544577:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c828d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c8294 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787114864.544582:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787114864.544597:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c828d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8294 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.544602:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787114864.544620:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c828d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8294 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.544626:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af0429ca200/0x194cd781e88c828d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8294 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.544635:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787114864.544638:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af052365000/0x194cd781e88c8271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8278 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.544644:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052365000 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1787114864.544647:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af052365000/0x194cd781e88c8271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c8278 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.544653:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af052365000/0x194cd781e88c8271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c8278 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787114864.544659:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af052365000/0x194cd781e88c8271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c8278 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787114864.544664:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787114864.544677:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af052365000/0x194cd781e88c8271 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8278 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.544683:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787114864.544688:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af052365000/0x194cd781e88c8271 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8278 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.544694:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af052365000/0x194cd781e88c8271 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8278 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114864.544842:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624588800:0@lo:103: 00000100:00100000:0.0:1787114864.544875:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787114864.545739:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:2.0:1787114864.545762:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624588928:0@lo:103: 00000100:00100000:2.0:1787114864.545796:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114864.545839:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787114864.545846:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624589056:0@lo:103: 00000100:00100000:2.0:1787114864.545867:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114864.545901:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624588800 00000100:00100000:2.0:1787114864.545907:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624588800 00010000:00010000:2.0:1787114864.545932:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af041682c00/0x194cd781e88c82be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c82b7 expref: 19 pid: 5778 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114864.545954:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624588928 00000100:00100000:2.0:1787114864.545958:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624588928 00010000:00010000:2.0:1787114864.545968:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af042cb2400/0x194cd781e88c8294 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c828d expref: 20 pid: 5780 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114864.545978:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624589056 00000100:00100000:2.0:1787114864.545981:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624589056 00010000:00010000:2.0:1787114864.545989:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af0429cb400/0x194cd781e88c8278 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8271 expref: 21 pid: 5780 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114864.546000:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787114864.546006:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bfcc0b7-8035-40e1-91c8-e687d170788c+21:3307:x1873925624588800:12345-0@lo:103: 00010000:00010000:2.0:1787114864.546018:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787114864.546024:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af041682c00/0x194cd781e88c82be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c82b7 expref: 21 pid: 5778 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114864.546033:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af041682c00/0x194cd781e88c82be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c82b7 expref: 21 pid: 5778 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114864.546050:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787114864.546080:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bfcc0b7-8035-40e1-91c8-e687d170788c+21:3307:x1873925624588800:12345-0@lo:103: Request processed in 74us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114864.546087:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787114864.546125:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787114864.546131:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bfcc0b7-8035-40e1-91c8-e687d170788c+20:3308:x1873925624588928:12345-0@lo:103: 00010000:00010000:2.0:1787114864.546140:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787114864.546144:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af042cb2400/0x194cd781e88c8294 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c828d expref: 20 pid: 5780 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114864.546153:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af042cb2400/0x194cd781e88c8294 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c828d expref: 20 pid: 5780 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114864.546163:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787114864.546189:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bfcc0b7-8035-40e1-91c8-e687d170788c+20:3308:x1873925624588928:12345-0@lo:103: Request processed in 58us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114864.546195:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787114864.546207:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787114864.546213:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624589056:12345-0@lo:103: 00010000:00010000:2.0:1787114864.546221:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787114864.546225:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af0429cb400/0x194cd781e88c8278 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8271 expref: 19 pid: 5780 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114864.546233:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af0429cb400/0x194cd781e88c8278 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c8271 expref: 19 pid: 5780 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114864.546242:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787114864.546263:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624589056:12345-0@lo:103: Request processed in 51us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114864.546269:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787114864.546323:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624588800:0@lo:103: 00000100:00100000:2.0:1787114864.546349:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624589056:0@lo:103: 00000100:00100000:2.0:1787114864.546368:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624588928:0@lo:103: 00010000:00010000:1.0:1787114864.546610:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787114864.546622:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c825c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.546631:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052365400 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1787114864.546635:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c825c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.546643:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c825c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787114864.546650:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c825c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787114864.546655:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787114864.546684:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8255 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c825c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.546690:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787114864.546845:0:8290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787114864.546852:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c8263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c826a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114864.546859:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364000 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1787114864.546862:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c8263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c826a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114864.546870:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c8263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c826a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787114864.546876:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c8263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c826a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787114864.546881:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787114864.546895:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c8263 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c826a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114864.546901:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787114864.547009:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624589184:0@lo:103: 00000100:00100000:0.0:1787114864.547041:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114864.547069:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787114864.547075:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624589312:0@lo:103: 00000100:00100000:0.0:1787114864.547095:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114864.547178:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624589184 00000100:00100000:0.0:1787114864.547182:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624589184 00010000:00010000:0.0:1787114864.547198:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af042cb3c00/0x194cd781e88c825c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8255 expref: 19 pid: 5780 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114864.547217:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624589312 00000100:00100000:0.0:1787114864.547219:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624589312 00010000:00010000:0.0:1787114864.547230:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af0429ca800/0x194cd781e88c826a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8263 expref: 20 pid: 5780 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114864.547247:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787114864.547253:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c15aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bfcc0b7-8035-40e1-91c8-e687d170788c+20:3306:x1873925624589184:12345-0@lo:103: 00010000:00010000:0.0:1787114864.547262:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787114864.547266:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af042cb3c00/0x194cd781e88c825c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8255 expref: 20 pid: 5780 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114864.547274:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af042cb3c00/0x194cd781e88c825c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c8255 expref: 20 pid: 5780 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114864.547312:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787114864.547341:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c15aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bfcc0b7-8035-40e1-91c8-e687d170788c+20:3306:x1873925624589184:12345-0@lo:103: Request processed in 88us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114864.547348:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787114864.547362:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787114864.547367:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c15a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624589312:12345-0@lo:103: 00010000:00010000:0.0:1787114864.547373:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787114864.547377:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af0429ca800/0x194cd781e88c826a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8263 expref: 19 pid: 5780 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114864.547385:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af0429ca800/0x194cd781e88c826a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c8263 expref: 19 pid: 5780 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114864.547399:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787114864.547422:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c15a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624589312:12345-0@lo:103: Request processed in 54us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114864.547428:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1787114864.547522:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8255 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c825c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.547531:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8255 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c825c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.547541:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787114864.547544:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c8201 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8208 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.547550:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052365a00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1787114864.547553:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c8201 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c8208 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.547570:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c8201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c8208 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787114864.547576:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c8201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c8208 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787114864.547581:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787114864.547600:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c8201 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8208 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.547605:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787114864.547616:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c8201 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8208 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.547622:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c8201 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8208 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.547633:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114864.547634:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114864.547636:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114864.547646:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624589440:0@lo:103: 00000100:00100000:1.0:1787114864.547669:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114864.547702:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624589440 00000100:00100000:1.0:1787114864.547717:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624589440 00010000:00010000:1.0:1787114864.547733:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af041682600/0x194cd781e88c8208 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8201 expref: 19 pid: 5779 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114864.547752:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787114864.547758:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624589440:12345-0@lo:103: 00010000:00010000:1.0:1787114864.547773:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787114864.547778:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af041682600/0x194cd781e88c8208 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8201 expref: 19 pid: 5779 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.547786:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af041682600/0x194cd781e88c8208 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c8201 expref: 19 pid: 5779 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.547795:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787114864.547820:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624589440:12345-0@lo:103: Request processed in 62us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114864.547826:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787114864.547852:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624589440:0@lo:103: 00010000:00010000:3.0:1787114864.548027:0:8285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af041682c00/0x194cd781e88c82be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c82b7 expref: 18 pid: 5778 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114864.548038:0:8285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8285:1873925624587904:0@lo:104: 00010000:00010000:3.0:1787114864.548050:0:8285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af042cb2400/0x194cd781e88c8294 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c828d expref: 17 pid: 5780 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114864.548057:0:8285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8285:1873925624588032:0@lo:104: 00010000:00010000:3.0:1787114864.548066:0:8285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af0429cb400/0x194cd781e88c8278 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c8271 expref: 16 pid: 5780 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114864.548073:0:8285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8285:1873925624588160:0@lo:104: 00010000:00010000:3.0:1787114864.548082:0:8285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af0429ca800/0x194cd781e88c826a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c8263 expref: 15 pid: 5780 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114864.548090:0:8285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8285:1873925624588288:0@lo:104: 00010000:00010000:3.0:1787114864.548133:0:8285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af042cb3c00/0x194cd781e88c825c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c8255 expref: 14 pid: 5780 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114864.548142:0:8285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb71180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8285:1873925624588416:0@lo:104: 00000100:00100000:3.0:1787114864.548153:0:8285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb73480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8285:1873925624588544:0@lo:104: 00010000:00010000:3.0:1787114864.548162:0:8285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af041682600/0x194cd781e88c8208 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c8201 expref: 13 pid: 5779 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114864.548170:0:8285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb73b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8285:1873925624588672:0@lo:104: 00010000:00010000:2.0:1787114864.548226:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c8263 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c826a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114864.548234:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c8263 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c826a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114864.548244:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114864.548246:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114864.548247:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114864.556556:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114864.556645:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1787114864.556692:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114864.556696:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114864.556698:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787114864.557138:0:8285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8285:1873925624587648:192.168.202.10@tcp:104: 00000100:00100000:3.0:1787114864.557154:0:8285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8285:1873925624587776:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787114864.557193:0:8285:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8af0429cb200/0x194cd781e88c830b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.557219:0:8290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c822b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8232 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.557227:0:8290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052365e00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:3.0:1787114864.557232:0:8290:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c822b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c8232 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.557242:0:8290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c822b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c8232 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787114864.557249:0:8290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c822b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c8232 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787114864.557255:0:8290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787114864.557315:0:8290:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c822b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8232 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.557323:0:8290:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787114864.557337:0:8290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c822b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8232 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.557344:0:8290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c822b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8232 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114864.557363:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787114864.557365:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787114864.557367:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114864.557497:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624589568:0@lo:103: 00000100:00100000:1.0:1787114864.557545:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114864.557607:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602545664 00000100:00100000:1.0:1787114864.557614:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602545664 00010000:00010000:1.0:1787114864.557638:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af052365200/0x194cd781e88c82d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d131a expref: 10 pid: 5780 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114864.557664:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602545792 00000100:00100000:1.0:1787114864.557667:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602545792 00010000:00010000:1.0:1787114864.557678:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af0429cb000/0x194cd781e88c82cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1313 expref: 11 pid: 5780 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114864.557689:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624589568 00000100:00100000:1.0:1787114864.557691:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624589568 00010000:00010000:1.0:1787114864.557702:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af042cb2c00/0x194cd781e88c8232 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c822b expref: 13 pid: 5779 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114864.557866:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 18 00000100:00100000:1.0:1787114864.557882:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+11:2363:x1873925602545664:12345-192.168.202.10@tcp:103: 00010000:00010000:1.0:1787114864.557895:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787114864.557902:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af052365200/0x194cd781e88c82d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d131a expref: 11 pid: 5780 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.557912:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af052365200/0x194cd781e88c82d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d131a expref: 11 pid: 5780 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.557926:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af052365200/0x194cd781e88c82d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d131a expref: 11 pid: 5780 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.557940:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787114864.557982:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2363:x1873925602545664:12345-192.168.202.10@tcp:103: Request processed in 101us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114864.557989:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 18 00000100:00100000:1.0:1787114864.558029:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00100000:1.0:1787114864.558036:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+9:2363:x1873925602545792:12345-192.168.202.10@tcp:103: 00010000:00010000:1.0:1787114864.558043:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787114864.558048:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af0429cb000/0x194cd781e88c82cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1313 expref: 9 pid: 5780 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.558068:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af0429cb000/0x194cd781e88c82cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1313 expref: 9 pid: 5780 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.558079:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af0429cb000/0x194cd781e88c82cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1313 expref: 9 pid: 5780 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.558087:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787114864.558134:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+8:2363:x1873925602545792:12345-192.168.202.10@tcp:103: Request processed in 98us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114864.558140:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00100000:1.0:1787114864.558152:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787114864.558157:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:3309:x1873925624589568:12345-0@lo:103: 00010000:00010000:1.0:1787114864.558166:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787114864.558171:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af042cb2c00/0x194cd781e88c8232 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c822b expref: 13 pid: 5779 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.558179:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af042cb2c00/0x194cd781e88c8232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c822b expref: 13 pid: 5779 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.558189:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af042cb2c00/0x194cd781e88c8232 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c822b expref: 13 pid: 5779 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.558199:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8af0429cb200/0x194cd781e88c830b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.558207:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af0429cb200/0x194cd781e88c830b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.558221:0:6592:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af0429cb200/0x194cd781e88c830b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.558228:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af0429cb200/0x194cd781e88c830b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.558234:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8af0429cb200/0x194cd781e88c830b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.558241:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8af0429cb200/0x194cd781e88c830b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.558252:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cb200 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:1.0:1787114864.558256:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8af0429cb200/0x194cd781e88c830b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.558264:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8af0429cb200/0x194cd781e88c830b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.558275:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8af0429cb200/0x194cd781e88c830b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114864.558285:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787114864.558326:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:3309:x1873925624589568:12345-0@lo:103: Request processed in 168us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114864.558332:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787114864.558817:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624589568:0@lo:103: 00010000:00010000:2.0:1787114864.561179:0:8285:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8af0429cb200/0x194cd781e88c830b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114864.561196:0:8285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8af0429cb200/0x194cd781e88c830b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114864.561202:0:8285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af0429cb200/0x194cd781e88c830b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114864.565403:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624589312:0@lo:103: 00000100:00100000:2.0:1787114864.565419:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624589184:0@lo:103: 00010000:00010000:1.0:1787114864.840175:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114865.018977:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114865.019017:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114865.019052:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114865.019235:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602546048 00000100:00100000:1.0:1787114865.019244:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602546048 00000100:00100000:1.0:1787114865.019359:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602546176 00000100:00100000:1.0:1787114865.019362:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602546176 00000100:00100000:1.0:1787114865.019380:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00100000:1.0:1787114865.019391:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2364:x1873925602546048:12345-192.168.202.10@tcp:400: 00000100:00100000:1.0:1787114865.019473:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2364:x1873925602546048:12345-192.168.202.10@tcp:400: Request processed in 84us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114865.019481:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00100000:1.0:1787114865.019497:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12 00000100:00100000:1.0:1787114865.019503:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2364:x1873925602546176:12345-192.168.202.10@tcp:400: 00000100:00100000:1.0:1787114865.019556:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2364:x1873925602546176:12345-192.168.202.10@tcp:400: Request processed in 54us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114865.019562:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12 00000100:00080000:2.0:1787114865.020452:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787114865.020458:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787114865.021161:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602545920 00000100:00100000:0.0:1787114865.021171:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602545920 00000100:00100000:0.0:1787114865.021238:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 27 00000100:00100000:0.0:1787114865.021248:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602545920:12345-192.168.202.10@tcp:400: 00000100:00100000:0.0:1787114865.021342:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602545920:12345-192.168.202.10@tcp:400: Request processed in 95us (2323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114865.021348:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 27 00000100:00080000:2.0:1787114865.021587:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787114865.863517:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787114865.925528:0:5782:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787114865.925536:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8af07b581000 from 39 10000000:01000000:2.0:1787114865.925541:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787114865.925591:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af042cb2000/0x194cd781e88c8312 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114865.925602:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af042cb2000/0x194cd781e88c8312 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114865.925634:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af042cb2000/0x194cd781e88c8312 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114865.925657:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624589696:0@lo:101: 00000100:00100000:2.0:1787114865.925743:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114865.925826:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5fa900 going to sleep for 11 seconds 00000100:00100000:3.0:1787114865.926100:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624589696 00000100:00100000:3.0:1787114865.926129:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624589696 00000100:00100000:3.0:1787114865.926197:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787114865.926205:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+12:5782:x1873925624589696:12345-0@lo:101: 00010000:00010000:3.0:1787114865.926218:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787114865.926231:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af0429ca800/0x194cd781e88c8319 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8312 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114865.926262:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af0429ca800/0x194cd781e88c8319 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8312 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114865.926271:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af0429ca800/0x194cd781e88c8319 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8312 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114865.926290:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429ca800, rc 0) 00000100:00100000:3.0:1787114865.926333:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:5782:x1873925624589696:12345-0@lo:101: Request processed in 129us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114865.926340:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787114865.926901:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624589696:0@lo:101: 00010000:00010000:2.0:1787114865.926919:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af042cb2000/0x194cd781e88c8312 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8319 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114865.926928:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af042cb2000/0x194cd781e88c8312 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8319 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114865.926995:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624589824:0@lo:501: 00000100:00100000:2.0:1787114865.927025:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114865.927058:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5fa900 going to sleep for 11 seconds 00000100:00100000:0.0:1787114865.927156:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624589824 00000100:00100000:0.0:1787114865.927160:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624589824 00000100:00100000:0.0:1787114865.927196:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787114865.927204:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:5782:x1873925624589824:12345-0@lo:501: 00000100:00100000:0.0:1787114865.927498:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:5782:x1873925624589824:12345-0@lo:501: Request processed in 294us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114865.927506:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787114865.927847:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624589824:0@lo:501: 00000100:00100000:2.0:1787114865.927876:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624589952:0@lo:503: 00000100:00100000:2.0:1787114865.927913:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114865.927939:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5fa900 going to sleep for 11 seconds 00000100:00100000:3.0:1787114865.928585:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624589952 00000100:00100000:3.0:1787114865.928592:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624589952 00000100:00100000:3.0:1787114865.928630:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787114865.928637:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:5782:x1873925624589952:12345-0@lo:503: 00000100:00100000:3.0:1787114865.928800:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:5782:x1873925624589952:12345-0@lo:503: Request processed in 163us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114865.928808:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787114865.928905:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624589952:0@lo:503: 00000100:00100000:1.0:1787114865.931238:0:8303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8303:1873925624590080:0@lo:502: 00000100:00100000:1.0:1787114865.931334:0:8303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114865.931379:0:8303:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06e9273c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787114865.931710:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624590080 00000100:00100000:3.0:1787114865.931716:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624590080 00000100:00100000:3.0:1787114865.931761:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787114865.931770:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:8303:x1873925624590080:12345-0@lo:502: 00000100:00100000:3.0:1787114865.931997:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:8303:x1873925624590080:12345-0@lo:502: Request processed in 227us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114865.932004:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787114865.932813:0:8303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8303:1873925624590080:0@lo:502: 00000100:00100000:1.0:1787114865.932868:0:8303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8303:1873925624590208:0@lo:502: 00000100:00100000:1.0:1787114865.932906:0:8303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114865.932941:0:8303:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06e9273c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787114865.934171:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624590208 00000100:00100000:3.0:1787114865.934180:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624590208 00000100:00100000:3.0:1787114865.934227:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787114865.934236:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:8303:x1873925624590208:12345-0@lo:502: 00000100:00100000:3.0:1787114865.934524:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:8303:x1873925624590208:12345-0@lo:502: Request processed in 288us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114865.934532:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787114865.934930:0:8303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8303:1873925624590208:0@lo:502: 00000040:00080000:1.0:1787114865.934961:0:8303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787114865.938586:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787114865.938623:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787114865.938636:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af042cb2000/0x194cd781e88c8312 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8319 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114865.938650:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af042cb2000/0x194cd781e88c8312 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8319 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787114865.938684:0:5782:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787114865.938687:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1787114865.938690:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787114865.938727:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429cb400/0x194cd781e88c8320 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114865.938736:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af0429cb400/0x194cd781e88c8320 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114865.938747:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af0429cb400/0x194cd781e88c8320 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114865.938771:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624590336:0@lo:101: 00000100:00100000:3.0:1787114865.938831:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114865.938882:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045a37240 going to sleep for 11 seconds 00000100:00100000:2.0:1787114865.939577:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624590336 00000100:00100000:2.0:1787114865.939586:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624590336 00000100:00100000:2.0:1787114865.939643:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787114865.939652:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+13:5782:x1873925624590336:12345-0@lo:101: 00010000:00010000:2.0:1787114865.939664:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114865.939685:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af042cb3e00/0x194cd781e88c8327 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8320 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114865.939707:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af042cb3e00/0x194cd781e88c8327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8320 expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114865.939717:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af042cb3e00/0x194cd781e88c8327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8320 expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114865.939726:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3e00, rc 0) 00000100:00100000:2.0:1787114865.939778:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:5782:x1873925624590336:12345-0@lo:101: Request processed in 128us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114865.939784:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787114865.940652:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624590336:0@lo:101: 00010000:00010000:0.0:1787114865.940668:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af0429cb400/0x194cd781e88c8320 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8327 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114865.940677:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af0429cb400/0x194cd781e88c8320 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8327 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114865.940738:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c159500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624590464:0@lo:501: 00000100:00100000:0.0:1787114865.940780:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114865.940817:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04303ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787114865.949300:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624590464 00000100:00100000:3.0:1787114865.949315:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624590464 00000100:00100000:3.0:1787114865.949384:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787114865.949394:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:5782:x1873925624590464:12345-0@lo:501: 00000100:00100000:3.0:1787114865.949727:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:5782:x1873925624590464:12345-0@lo:501: Request processed in 334us (8946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114865.949735:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787114865.950093:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c159500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624590464:0@lo:501: 00000100:00100000:2.0:1787114865.950182:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624590592:0@lo:503: 00000100:00100000:2.0:1787114865.950228:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114865.950253:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5fa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787114865.950379:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624590592 00000100:00100000:0.0:1787114865.950385:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624590592 00000100:00100000:0.0:1787114865.950427:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787114865.950442:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:5782:x1873925624590592:12345-0@lo:503: 00000100:00100000:0.0:1787114865.950593:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:5782:x1873925624590592:12345-0@lo:503: Request processed in 158us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114865.950599:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787114865.950639:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624590592:0@lo:503: 00000100:00100000:0.0:1787114865.950820:0:8304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8304:1873925624590720:0@lo:502: 00000100:00100000:0.0:1787114865.950856:0:8304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114865.950874:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624590720 00000100:00100000:0.0:1787114865.950878:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624590720 00000100:00100000:0.0:1787114865.950893:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787114865.950898:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:8304:x1873925624590720:12345-0@lo:502: 00000100:00100000:0.0:1787114865.951006:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:8304:x1873925624590720:12345-0@lo:502: Request processed in 106us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114865.951012:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787114865.951043:0:8304:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04303f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787114865.951055:0:8304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8304:1873925624590720:0@lo:502: 00000020:01000000:0.0:1787114865.951077:0:8304:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787114865.951085:0:8304:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787114865.951088:0:8304:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787114865.951093:0:8304:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787114865.951136:0:8304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8304:1873925624590848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787114865.951174:0:8304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114865.951194:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624590848 00000100:00100000:0.0:1787114865.951198:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624590848 00000100:00100000:0.0:1787114865.951214:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787114865.951220:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:8304:x1873925624590848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787114865.951339:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:8304:x1873925624590848:12345-0@lo:502:llog_process_th.0 Request processed in 119us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114865.951346:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787114865.951373:0:8304:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06c2ddd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787114865.951385:0:8304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8304:1873925624590848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787114865.951402:0:8304:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787114865.951406:0:8304:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787114865.951408:0:8304:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787114865.951411:0:8304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1787114865.951457:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787114865.951472:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787114865.951481:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429cb400/0x194cd781e88c8320 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8327 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114865.951490:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af0429cb400/0x194cd781e88c8320 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8327 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114865.951499:0:5782:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787114865.951502:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8af06f41d000 from 39 10000000:01000000:0.0:1787114865.951505:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787114865.951527:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052364200/0x194cd781e88c832e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114865.951535:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af052364200/0x194cd781e88c832e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114865.951551:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af052364200/0x194cd781e88c832e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114865.951565:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624590976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787114865.951590:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114865.951603:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04838e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787114865.951615:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624590976 00000100:00100000:0.0:1787114865.951618:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624590976 00000100:00100000:0.0:1787114865.951633:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787114865.951637:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:5782:x1873925624590976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787114865.951646:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114865.951657:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af052365c00/0x194cd781e88c8335 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c832e expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114865.951676:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af052365c00/0x194cd781e88c8335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c832e expref: 15 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114865.951686:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af052365c00/0x194cd781e88c8335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c832e expref: 15 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114865.951694:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052365c00, rc 0) 00000100:00100000:0.0:1787114865.951722:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:5782:x1873925624590976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114865.951728:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787114865.951757:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624590976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787114865.951769:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af052364200/0x194cd781e88c832e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8335 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114865.951783:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af052364200/0x194cd781e88c832e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8335 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114865.951817:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624591104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787114865.951840:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114865.951853:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04838e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787114865.951863:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624591104 00000100:00100000:0.0:1787114865.951866:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624591104 00000100:00100000:0.0:1787114865.951882:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787114865.951887:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051311050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:5782:x1873925624591104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787114865.952063:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051311050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:5782:x1873925624591104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114865.952070:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787114865.952096:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624591104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787114865.952141:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624591232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787114865.952174:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114865.952188:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04838e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787114865.952198:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624591232 00000100:00100000:0.0:1787114865.952202:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624591232 00000100:00100000:0.0:1787114865.952217:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787114865.952222:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051312c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:5782:x1873925624591232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787114865.952354:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051312c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:5782:x1873925624591232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114865.952360:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787114865.952399:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624591232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787114865.952636:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8305:1873925624591360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787114865.952669:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114865.952687:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624591360 00000100:00100000:0.0:1787114865.952691:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624591360 00000100:00100000:0.0:1787114865.952706:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787114865.952712:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051311850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:8305:x1873925624591360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787114865.952844:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051311850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:8305:x1873925624591360:12345-0@lo:502:llog_process_th.0 Request processed in 132us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114865.952851:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787114865.952875:0:8305:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0507979c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787114865.952886:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8305:1873925624591360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787114865.952920:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8305:1873925624591488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787114865.952950:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114865.952967:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624591488 00000100:00100000:0.0:1787114865.952970:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624591488 00000100:00100000:0.0:1787114865.952984:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787114865.952988:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051313850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:8305:x1873925624591488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787114865.953091:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051313850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:8305:x1873925624591488:12345-0@lo:502:llog_process_th.0 Request processed in 101us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114865.953097:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787114865.953163:0:8305:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0507979c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787114865.953174:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8305:1873925624591488:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787114865.953192:0:8305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787114865.953229:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787114865.953240:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787114865.953247:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052364200/0x194cd781e88c832e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8335 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114865.953255:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af052364200/0x194cd781e88c832e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8335 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114865.953263:0:5782:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787114865.953265:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787114865.953267:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787114865.964220:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c833c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114865.964241:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c833c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114865.964253:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c833c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114865.964294:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624591616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787114865.964362:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114865.964427:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0507979c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787114865.980205:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624591616 00000100:00100000:2.0:1787114865.980222:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624591616 00000100:00100000:3.0:1787114865.980970:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787114865.980983:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051310850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:5782:x1873925624591616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787114865.981011:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787114865.981031:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af0429cb600/0x194cd781e88c8343 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c833c expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114865.981078:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af0429cb600/0x194cd781e88c8343 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c833c expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114865.981088:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af0429cb600/0x194cd781e88c8343 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c833c expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114865.981097:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429cb600, rc 0) 00000100:00100000:3.0:1787114865.981215:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051310850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:5782:x1873925624591616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 235us (16852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114865.981223:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787114865.981622:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624591616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787114865.981640:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c833c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8343 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114865.981650:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c833c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8343 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114865.981717:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624591744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787114865.981754:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114865.981788:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06e927000 going to sleep for 11 seconds 00000100:00100000:3.0:1787114865.981912:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624591744 00000100:00100000:3.0:1787114865.981918:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624591744 00000100:00100000:3.0:1787114865.981954:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787114865.981961:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051310450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:5782:x1873925624591744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787114865.982240:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051310450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:5782:x1873925624591744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114865.982248:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787114865.985011:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624591744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787114865.985124:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624591872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787114865.985207:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114865.985246:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06e927000 going to sleep for 11 seconds 00000100:00100000:3.0:1787114865.989705:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624591872 00000100:00100000:3.0:1787114865.989721:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624591872 00000100:00100000:3.0:1787114865.989785:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787114865.989794:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051313450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:5782:x1873925624591872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787114865.990024:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051313450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:5782:x1873925624591872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 230us (4815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114865.990032:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787114865.994524:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624591872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787114866.005651:0:8306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8306:1873925624592000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787114866.005743:0:8306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114866.005800:0:8306:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06e927600 going to sleep for 11 seconds 00000100:00100000:0.0:1787114866.005879:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624592000 00000100:00100000:0.0:1787114866.005888:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624592000 00000100:00100000:0.0:1787114866.005947:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787114866.005957:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051311450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:8306:x1873925624592000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787114866.006214:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051311450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:8306:x1873925624592000:12345-0@lo:502:llog_process_th.0 Request processed in 257us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114866.006222:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787114866.006491:0:8306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8306:1873925624592000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787114866.006519:0:8306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787114866.006528:0:8306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787114866.006530:0:8306:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787114866.006536:0:8306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787114866.006558:0:8306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8306:1873925624592128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787114866.006593:0:8306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114866.006623:0:8306:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06e927600 going to sleep for 11 seconds 00000100:00100000:0.0:1787114866.009175:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624592128 00000100:00100000:0.0:1787114866.009189:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624592128 00000100:00100000:0.0:1787114866.009254:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787114866.009263:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051312450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:8306:x1873925624592128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787114866.009772:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051312450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:8306:x1873925624592128:12345-0@lo:502:llog_process_th.0 Request processed in 509us (3177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114866.009779:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787114866.010683:0:8306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8306:1873925624592128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787114866.010722:0:8306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787114866.010729:0:8306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787114866.010732:0:8306:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787114866.010736:0:8306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1787114866.011292:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787114866.011309:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787114866.011320:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c833c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8343 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114866.011331:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c833c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8343 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114866.011341:0:5782:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787114866.011344:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8af05032f000 from 39 10000000:01000000:0.0:1787114866.011347:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787114866.011381:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c834a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114866.011388:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c834a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114866.011398:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c834a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114866.011418:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624592256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787114866.014665:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114866.014730:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050797000 going to sleep for 11 seconds 00000100:00100000:2.0:1787114866.016281:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624592256 00000100:00100000:2.0:1787114866.016294:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624592256 00000100:00100000:2.0:1787114866.016360:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787114866.016371:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051312050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:5782:x1873925624592256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787114866.016387:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114866.016406:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af042cb2600/0x194cd781e88c8351 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c834a expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114866.016435:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af042cb2600/0x194cd781e88c8351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c834a expref: 17 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114866.016470:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af042cb2600/0x194cd781e88c8351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c834a expref: 17 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114866.016479:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2600, rc 0) 00000100:00100000:2.0:1787114866.016657:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051312050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624592256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 288us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114866.016664:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787114866.017267:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624592256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787114866.017299:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c834a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8351 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114866.017310:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c834a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8351 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114866.017378:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624592384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787114866.017414:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114866.018715:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624592384 00000100:00100000:2.0:1787114866.018724:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624592384 00000100:00100000:2.0:1787114866.018772:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787114866.018781:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051310050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624592384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787114866.019063:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051310050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624592384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114866.019071:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787114866.024710:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050797000 going to sleep for 11 seconds 00000100:00100000:0.0:1787114866.024759:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624592384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787114866.024820:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624592512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787114866.024906:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114866.024937:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050797000 going to sleep for 11 seconds 00000100:00100000:3.0:1787114866.026592:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624592512 00000100:00100000:3.0:1787114866.026603:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624592512 00000100:00100000:3.0:1787114866.026675:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787114866.026684:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051311c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624592512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787114866.026914:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051311c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624592512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114866.026922:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787114866.028049:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624592512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787114866.037391:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8307:1873925624592640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787114866.037518:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114866.037576:0:8307:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5fa840 going to sleep for 11 seconds 00000100:00100000:3.0:1787114866.037798:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624592640 00000100:00100000:3.0:1787114866.037805:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624592640 00000100:00100000:3.0:1787114866.037876:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787114866.037886:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051313050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:8307:x1873925624592640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787114866.038172:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051313050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:8307:x1873925624592640:12345-0@lo:502:llog_process_th.0 Request processed in 287us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114866.038180:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787114866.038726:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8307:1873925624592640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787114866.038784:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8307:1873925624592768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787114866.038836:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114866.038876:0:8307:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5fa840 going to sleep for 11 seconds 00000100:00100000:0.0:1787114866.039071:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624592768 00000100:00100000:0.0:1787114866.039077:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624592768 00000100:00100000:0.0:1787114866.039139:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787114866.039147:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051313c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:8307:x1873925624592768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787114866.039334:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051313c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:8307:x1873925624592768:12345-0@lo:502:llog_process_th.0 Request processed in 187us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114866.039340:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787114866.039728:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8307:1873925624592768:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787114866.039750:0:8307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787114866.042985:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787114866.043017:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787114866.043030:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c834a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8351 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114866.043057:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c834a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8351 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114866.043079:0:5782:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787114866.043082:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787114866.043085:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787114866.043155:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114866.043164:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114866.043175:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114866.043199:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624592896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787114866.043264:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114866.043314:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0507970c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787114866.043377:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624592896 00000100:00100000:3.0:1787114866.043385:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624592896 00000100:00100000:3.0:1787114866.043450:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787114866.043459:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051312850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624592896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787114866.043472:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787114866.043486:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af0429cb800/0x194cd781e88c835f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8358 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114866.043724:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af0429cb800/0x194cd781e88c835f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8358 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114866.043735:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af0429cb800/0x194cd781e88c835f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8358 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114866.043745:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429cb800, rc 0) 00000100:00100000:3.0:1787114866.043791:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051312850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624592896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 333us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114866.043807:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787114866.044103:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624592896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787114866.044147:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8358 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c835f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114866.044156:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8358 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c835f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114866.044215:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624593024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787114866.044243:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114866.044261:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06e927000 going to sleep for 11 seconds 00000100:00100000:0.0:1787114866.044694:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624593024 00000100:00100000:0.0:1787114866.044700:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624593024 00000100:00100000:0.0:1787114866.044740:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787114866.044747:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051310c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624593024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787114866.045008:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051310c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624593024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114866.045015:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787114866.045152:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624593024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787114866.045194:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624593152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787114866.045236:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114866.045257:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5fa840 going to sleep for 11 seconds 00000100:00100000:0.0:1787114866.045310:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624593152 00000100:00100000:0.0:1787114866.045314:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624593152 00000100:00100000:0.0:1787114866.045334:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787114866.045345:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624593152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787114866.046020:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624593152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 672us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114866.046028:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787114866.046242:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624593152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787114866.047695:0:8308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb71180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8308:1873925624593280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787114866.047760:0:8308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114866.047799:0:8308:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050faa300 going to sleep for 11 seconds 00000100:00100000:0.0:1787114866.048332:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624593280 00000100:00100000:0.0:1787114866.048340:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624593280 00000100:00100000:0.0:1787114866.048384:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787114866.048393:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:8308:x1873925624593280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787114866.049096:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:8308:x1873925624593280:12345-0@lo:502:llog_process_th.0 Request processed in 703us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114866.049126:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787114866.049660:0:8308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb71180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8308:1873925624593280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787114866.049694:0:8308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787114866.049704:0:8308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787114866.049706:0:8308:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787114866.049712:0:8308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787114866.049744:0:8308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb71180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8308:1873925624593408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787114866.049789:0:8308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114866.049835:0:8308:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050faa300 going to sleep for 11 seconds 00000100:00100000:1.0:1787114866.049892:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624593408 00000100:00100000:1.0:1787114866.049898:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624593408 00000100:00100000:1.0:1787114866.049939:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787114866.049947:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:8308:x1873925624593408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787114866.050148:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:8308:x1873925624593408:12345-0@lo:502:llog_process_th.0 Request processed in 201us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114866.050156:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787114866.051140:0:8308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb71180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8308:1873925624593408:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787114866.051170:0:8308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787114866.051176:0:8308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787114866.051178:0:8308:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787114866.051182:0:8308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787114866.053381:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1787114866.053413:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787114866.053445:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8358 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c835f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114866.053457:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c835f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787114866.053468:0:5782:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787114866.053471:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8af05916cd40 from 1 10000000:01000000:1.0:1787114866.053473:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787114866.053523:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041682e00/0x194cd781e88c8366 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114866.053530:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af041682e00/0x194cd781e88c8366 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114866.053556:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af041682e00/0x194cd781e88c8366 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114866.053580:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624593536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787114866.053640:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114866.053683:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06e9273c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787114866.055840:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624593536 00000100:00100000:0.0:1787114866.055853:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624593536 00000100:00100000:0.0:1787114866.055929:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787114866.055939:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624593536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787114866.055956:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114866.055976:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af052365a00/0x194cd781e88c836d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8366 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114866.056010:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af052365a00/0x194cd781e88c836d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8366 expref: 19 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114866.056042:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af052365a00/0x194cd781e88c836d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8366 expref: 19 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114866.056052:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052365a00, rc 0) 00000100:00100000:0.0:1787114866.056168:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:5782:x1873925624593536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (2527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114866.056176:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787114866.056636:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aedf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624593536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787114866.056660:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af041682e00/0x194cd781e88c8366 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c836d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114866.056670:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af041682e00/0x194cd781e88c8366 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c836d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114866.056752:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624593664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787114866.056788:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114866.056838:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050faa600 going to sleep for 11 seconds 00000100:00100000:1.0:1787114866.057083:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624593664 00000100:00100000:1.0:1787114866.057089:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624593664 00000100:00100000:1.0:1787114866.057140:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787114866.057148:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:5782:x1873925624593664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787114866.057386:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:5782:x1873925624593664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (597us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787114866.057394:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787114866.062012:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624593664:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787114866.062073:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787114866.062084:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041682e00/0x194cd781e88c8366 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c836d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114866.062144:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af041682e00/0x194cd781e88c8366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c836d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114866.566604:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624593920:0@lo:400:kworker.0 00000100:00100000:1.0:1787114866.566674:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114866.566743:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624594432:0@lo:400:kworker.0 00000100:00100000:1.0:1787114866.566768:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114866.566800:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787114866.566806:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624593792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787114866.566831:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114866.566849:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07398a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873925624594304:0@lo:400:kworker.0 00000100:00100000:1.0:1787114866.566868:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114866.566893:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624594176:0@lo:400:kworker.0 00000100:00100000:1.0:1787114866.566914:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114866.566940:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787114866.566946:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624594048:0@lo:400:kworker.0 00000100:00100000:1.0:1787114866.566968:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114866.566996:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624594432 00000100:00100000:1.0:1787114866.567003:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624594432 00000100:00100000:1.0:1787114866.567057:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624594176 00000100:00100000:1.0:1787114866.567061:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624594176 00000100:00100000:1.0:1787114866.567079:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787114866.567087:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624594432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114866.567174:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624594432:12345-0@lo:400:kworker.0 Request processed in 87us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114866.567182:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787114866.567197:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787114866.567204:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624594176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114866.567236:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624594176:12345-0@lo:400:kworker.0 Request processed in 33us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114866.567242:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787114866.567261:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624593792 00000100:00100000:1.0:1787114866.567264:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624593792 00000100:00100000:1.0:1787114866.567308:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787114866.567315:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624593792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787114866.567341:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787114866.567373:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624593792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114866.567379:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787114866.567397:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624593920 00000100:00100000:1.0:1787114866.567401:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624593920 00000100:00100000:1.0:1787114866.567425:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624594304 00000100:00100000:1.0:1787114866.567445:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624594304 00000100:00100000:1.0:1787114866.567464:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624594048 00000100:00100000:1.0:1787114866.567466:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624594048 00000100:00100000:1.0:1787114866.567480:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787114866.567485:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624593920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114866.567516:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624593920:12345-0@lo:400:kworker.0 Request processed in 30us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114866.567522:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787114866.567533:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787114866.567539:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873925624594304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114866.567565:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873925624594304:12345-0@lo:400:kworker.0 Request processed in 26us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114866.567570:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787114866.567580:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787114866.567585:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624594048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114866.567612:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624594048:12345-0@lo:400:kworker.0 Request processed in 27us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114866.567618:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787114866.567640:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787114866.567644:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787114866.567646:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787114866.567679:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624594048:0@lo:400:kworker.0 00010000:00080000:1.0:1787114866.567692:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af073989f80 x1873925624594176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114866.567703:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624594176:0@lo:400:kworker.0 00010000:00080000:1.0:1787114866.567733:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af06c159c00 x1873925624593792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114866.567753:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624593792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787114866.567765:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07398a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873925624594304:0@lo:400:kworker.0 00000100:00100000:1.0:1787114866.567773:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624593920:0@lo:400:kworker.0 00010000:00080000:1.0:1787114866.567781:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af073989180 x1873925624594432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114866.567789:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624594432:0@lo:400:kworker.0 00000100:00100000:2.0:1787114866.880717:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114866.880933:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602546304 00000100:00100000:1.0:1787114866.880944:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602546304 00000100:00100000:1.0:1787114866.881009:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 161 00000100:00100000:1.0:1787114866.881020:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+8:5579:x1873925602546304:12345-192.168.202.10@tcp:101: 00010000:00010000:1.0:1787114866.881040:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787114866.881060:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af041683e00/0x194cd781e88c8374 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d137c expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114866.881100:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af041683e00/0x194cd781e88c8374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d137c expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114866.881465:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af041683e00/0x194cd781e88c8374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d137c expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114866.881475:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041683e00, rc 0) 00000100:00100000:1.0:1787114866.881538:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+9:5579:x1873925602546304:12345-192.168.202.10@tcp:101: Request processed in 519us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114866.881545:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 161 00010000:00010000:0.0:1787114866.886170:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114866.886376:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114866.886469:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602546432 00000100:00100000:3.0:1787114866.886480:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602546432 00000100:00100000:3.0:1787114866.886533:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 162 00000100:00100000:3.0:1787114866.886543:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+9:5579:x1873925602546432:12345-192.168.202.10@tcp:501: 00000100:00100000:3.0:1787114866.886838:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+9:5579:x1873925602546432:12345-192.168.202.10@tcp:501: Request processed in 295us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114866.886847:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 162 00000100:00100000:2.0:1787114866.889217:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114866.889396:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602546560 00000100:00100000:0.0:1787114866.889404:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602546560 00000100:00100000:0.0:1787114866.889456:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 163 00000100:00100000:0.0:1787114866.889464:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+9:5579:x1873925602546560:12345-192.168.202.10@tcp:503: 00000100:00100000:0.0:1787114866.889659:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+9:5579:x1873925602546560:12345-192.168.202.10@tcp:503: Request processed in 195us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114866.889666:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 163 00000100:00100000:2.0:1787114866.918753:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114866.919070:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602546688 00000100:00100000:0.0:1787114866.919080:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602546688 00000100:00100000:0.0:1787114866.919165:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 164 00000100:00100000:0.0:1787114866.919176:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+9:6052:x1873925602546688:12345-192.168.202.10@tcp:502: 00000100:00100000:0.0:1787114866.919538:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+9:6052:x1873925602546688:12345-192.168.202.10@tcp:502: Request processed in 362us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114866.919547:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 164 00000100:00100000:2.0:1787114866.926538:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114866.926664:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602546816 00000100:00100000:3.0:1787114866.926675:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602546816 00000100:00100000:3.0:1787114866.926823:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 165 00000100:00100000:3.0:1787114866.926834:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+9:6052:x1873925602546816:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787114866.927470:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+9:6052:x1873925602546816:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 637us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114866.927479:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 165 00000100:00100000:2.0:1787114866.940012:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114866.940192:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602546944 00000100:00100000:1.0:1787114866.940203:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602546944 00000100:00100000:1.0:1787114866.940316:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 166 00000100:00100000:1.0:1787114866.940327:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+9:5579:x1873925602546944:12345-192.168.202.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787114866.940344:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787114866.940362:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af041683800/0x194cd781e88c837b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1383 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114866.940391:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af041683800/0x194cd781e88c837b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1383 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114866.940403:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af041683800/0x194cd781e88c837b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1383 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114866.940413:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041683800, rc 0) 00000100:00100000:1.0:1787114866.940512:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:5579:x1873925602546944:12345-192.168.202.10@tcp:101:ll_cfg_requeue.0 Request processed in 185us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114866.940519:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 166 00000100:00100000:2.0:1787114866.958816:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114866.958858:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602547072 00000100:00100000:3.0:1787114866.958870:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602547072 00000100:00100000:3.0:1787114866.958928:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 167 00000100:00100000:3.0:1787114866.958938:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:5579:x1873925602547072:12345-192.168.202.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787114866.959444:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:5579:x1873925602547072:12345-192.168.202.10@tcp:501:ll_cfg_requeue.0 Request processed in 507us (636us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787114866.959452:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 167 00000100:00100000:2.0:1787114867.077971:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787114867.077997:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624594560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787114867.078085:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114867.078355:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624594560 00000100:00100000:0.0:1787114867.078365:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624594560 00000100:00100000:0.0:1787114867.078424:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787114867.078434:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07398b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624594560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787114867.078481:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787114867.078543:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07398b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624594560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114867.078551:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787114867.078637:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af06c159f80 x1873925624594560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114867.078655:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624594560:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787114867.910246:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787114868.685778:0:8345:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd608279d0 20000000:00000080:3.0:1787114868.685795:0:8345:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8af047e68400 uarg=0000000000000000 20000000:01000000:3.0:1787114868.685829:0:8345:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787114868.685835:0:8345:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787114868.685840:0:8345:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787114868.686883:0:8346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1787114868.687058:0:8345:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1787114868.692806:0:8345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1787114868.692859:0:8345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1787114868.692913:0:8345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1787114868.692930:0:8345:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787114868.692949:0:8345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8af0429cae00/0x194cd781e88c8382 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114868.692967:0:8345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af08216e800/0x194cd781e88c80f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c80f0 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114868.692976:0:8345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af0429ca600/0x194cd781e88c8159 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8152 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114868.692983:0:8345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af041682000/0x194cd781e88c8224 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c821d expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114868.692992:0:8345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af0429cba00/0x194cd781e88c82e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d134b expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114868.693000:0:8345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8af0429cae00/0x194cd781e88c8382 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114868.693047:0:8345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af0429cba00/0x194cd781e88c82e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d134b expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114868.693065:0:8345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af0429cba00/0x194cd781e88c82e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d134b expref: 9 pid: 5778 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114868.693081:0:8345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8345:1873925624594688:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787114868.693614:0:8345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af041682000/0x194cd781e88c8224 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c821d expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114868.693625:0:8345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af041682000/0x194cd781e88c8224 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c821d expref: 18 pid: 5780 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114868.693635:0:8345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb72d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8345:1873925624594816:0@lo:104: 00000100:00100000:3.0:1787114868.693679:0:8345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787114868.693721:0:8345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af0429ca600/0x194cd781e88c8159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c8152 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114868.693729:0:8345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af0429ca600/0x194cd781e88c8159 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c8152 expref: 18 pid: 5779 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114868.693737:0:8345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb71880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8345:1873925624594944:0@lo:104: 00000100:00100000:3.0:1787114868.693760:0:8345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787114868.693780:0:8345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af08216e800/0x194cd781e88c80f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c80f0 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114868.693787:0:8345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af08216e800/0x194cd781e88c80f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c80f0 expref: 18 pid: 5779 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114868.693806:0:8345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb70000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8345:1873925624595072:0@lo:104: 00000100:00100000:3.0:1787114868.693825:0:8345:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042d2da80 going to sleep for 11 seconds 00000100:00100000:0.0:1787114868.693944:0:5768:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787114868.693964:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114868.693975:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624594816 00000100:00100000:0.0:1787114868.693981:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624594816 00000100:00100000:0.0:1787114868.694016:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624594944 00000100:00100000:0.0:1787114868.694019:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624594944 00000100:00100000:0.0:1787114868.694029:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624595072 00000100:00100000:0.0:1787114868.694031:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624595072 00000100:00100000:0.0:1787114868.694044:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787114868.694052:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+5:8345:x1873925624594816:12345-0@lo:104: 00010000:00010000:0.0:1787114868.694064:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af0429cbe00/0x194cd781e88c821d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8224 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.694154:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787114868.694161:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+5:8345:x1873925624594816:12345-0@lo:104: Request processed in 109us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114868.694167:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787114868.694184:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787114868.694189:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+4:8345:x1873925624594944:12345-0@lo:104: 00010000:00010000:0.0:1787114868.694196:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c8152 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8159 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.694230:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787114868.694234:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+4:8345:x1873925624594944:12345-0@lo:104: Request processed in 46us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114868.694259:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787114868.694295:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787114868.694300:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c159f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:8345:x1873925624595072:12345-0@lo:104: 00010000:00010000:0.0:1787114868.694308:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af041683000/0x194cd781e88c80f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c80f7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.694339:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787114868.694343:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c159f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:8345:x1873925624595072:12345-0@lo:104: Request processed in 44us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114868.694349:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787114868.694366:0:8291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787114868.694371:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af0429cbe00/0x194cd781e88c821d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8224 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.694378:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cbe00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:0.0:1787114868.694381:0:8291:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af0429cbe00/0x194cd781e88c821d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c8224 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.694389:0:8291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af0429cbe00/0x194cd781e88c821d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c8224 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787114868.694396:0:8291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af0429cbe00/0x194cd781e88c821d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c8224 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114868.694401:0:8291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787114868.694438:0:8291:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af0429cbe00/0x194cd781e88c821d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8224 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.694444:0:8291:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787114868.694467:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af0429cbe00/0x194cd781e88c821d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8224 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.694473:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af0429cbe00/0x194cd781e88c821d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8224 expref: -99 pid: 7467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.694485:0:8291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787114868.694488:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c8152 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8159 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.694494:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682400 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:0.0:1787114868.694496:0:8291:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c8152 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c8159 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.694503:0:8291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c8152 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c8159 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787114868.694510:0:8291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c8152 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c8159 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114868.694515:0:8291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787114868.694527:0:8291:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c8152 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8159 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.694531:0:8291:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787114868.694544:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c8152 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8159 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.694550:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c8152 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8159 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.694557:0:8291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787114868.694564:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af041683000/0x194cd781e88c80f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c80f7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.694570:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041683000 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:0.0:1787114868.694573:0:8291:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af041683000/0x194cd781e88c80f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c80f7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.694579:0:8291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af041683000/0x194cd781e88c80f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c80f7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787114868.694585:0:8291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af041683000/0x194cd781e88c80f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c80f7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114868.694589:0:8291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787114868.694614:0:8291:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af041683000/0x194cd781e88c80f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c80f7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.694619:0:8291:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787114868.694625:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af041683000/0x194cd781e88c80f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c80f7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.694631:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af041683000/0x194cd781e88c80f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c80f7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.694644:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114868.694646:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114868.694648:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114868.694666:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624595200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787114868.694692:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114868.694722:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624595328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787114868.694752:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114868.694769:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787114868.694774:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624595456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787114868.694788:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114868.694810:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624595200 00000100:00100000:0.0:1787114868.694814:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624595200 00010000:00010000:0.0:1787114868.694829:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af041682000/0x194cd781e88c8224 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c821d expref: 19 pid: 5780 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114868.694846:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624595328 00000100:00100000:0.0:1787114868.694849:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624595328 00010000:00010000:0.0:1787114868.694857:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af0429ca600/0x194cd781e88c8159 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8152 expref: 20 pid: 5779 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114868.694865:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624595456 00000100:00100000:0.0:1787114868.694867:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624595456 00010000:00010000:0.0:1787114868.694874:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af08216e800/0x194cd781e88c80f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c80f0 expref: 21 pid: 5779 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114868.694885:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787114868.694890:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c159500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+21:3309:x1873925624595200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787114868.694899:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787114868.694904:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af041682000/0x194cd781e88c8224 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c821d expref: 21 pid: 5780 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.694913:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af041682000/0x194cd781e88c8224 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c821d expref: 21 pid: 5780 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.694927:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787114868.694954:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c159500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+21:3309:x1873925624595200:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114868.694967:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787114868.694980:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787114868.694985:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+20:3306:x1873925624595328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787114868.694993:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787114868.694997:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af0429ca600/0x194cd781e88c8159 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8152 expref: 20 pid: 5779 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.695005:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af0429ca600/0x194cd781e88c8159 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c8152 expref: 20 pid: 5779 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.695015:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787114868.695040:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+20:3306:x1873925624595328:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114868.695046:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787114868.695059:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787114868.695065:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c15aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624595456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787114868.695072:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787114868.695076:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af08216e800/0x194cd781e88c80f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c80f0 expref: 19 pid: 5779 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.695083:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af08216e800/0x194cd781e88c80f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c80f0 expref: 19 pid: 5779 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.695092:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787114868.695133:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c15aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624595456:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114868.695139:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787114868.695170:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624595200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787114868.695202:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624595456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787114868.695209:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624595328:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787114868.695406:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787114868.695963:0:8345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af041682000/0x194cd781e88c8224 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c821d expref: 18 pid: 5780 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114868.695977:0:8345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb72d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8345:1873925624594816:0@lo:104: 00010000:00010000:3.0:1787114868.695988:0:8345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af0429ca600/0x194cd781e88c8159 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c8152 expref: 17 pid: 5779 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114868.695997:0:8345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb71880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8345:1873925624594944:0@lo:104: 00010000:00010000:3.0:1787114868.696006:0:8345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af08216e800/0x194cd781e88c80f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c80f0 expref: 16 pid: 5779 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114868.696015:0:8345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb70000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8345:1873925624595072:0@lo:104: 00010000:00010000:1.0:1787114868.696448:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114868.698507:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114868.698614:0:8345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8345:1873925624594688:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787114868.698649:0:8345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8af0429cae00/0x194cd781e88c8382 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114868.698753:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602547200 00000100:00100000:0.0:1787114868.698760:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602547200 00010000:00010000:0.0:1787114868.698790:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af0429cba00/0x194cd781e88c82e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d134b expref: 10 pid: 5778 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114868.698828:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 24 00000100:00100000:0.0:1787114868.698837:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07398bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2364:x1873925602547200:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787114868.698851:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787114868.698858:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af0429cba00/0x194cd781e88c82e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d134b expref: 10 pid: 5778 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.698868:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af0429cba00/0x194cd781e88c82e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d134b expref: 10 pid: 5778 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.699302:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af0429cba00/0x194cd781e88c82e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d134b expref: 10 pid: 5778 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.699319:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8af0429cae00/0x194cd781e88c8382 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114868.699327:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af0429cae00/0x194cd781e88c8382 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114868.699430:0:5770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af0429cae00/0x194cd781e88c8382 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114868.699439:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af0429cae00/0x194cd781e88c8382 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114868.699445:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8af0429cae00/0x194cd781e88c8382 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114868.699452:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8af0429cae00/0x194cd781e88c8382 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114868.699459:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cae00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787114868.699474:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8af0429cae00/0x194cd781e88c8382 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114868.699482:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8af0429cae00/0x194cd781e88c8382 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114868.699503:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8af0429cae00/0x194cd781e88c8382 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114868.699515:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787114868.699570:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07398bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+9:2364:x1873925602547200:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 733us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114868.699578:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 24 00010000:00010000:3.0:1787114868.699687:0:8345:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8af0429cae00/0x194cd781e88c8382 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114868.699695:0:8345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8af0429cae00/0x194cd781e88c8382 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114868.699701:0:8345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af0429cae00/0x194cd781e88c8382 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114868.935029:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114869.873640:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114869.873726:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602547328 00000100:00100000:0.0:1787114869.873735:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602547328 00000100:00100000:0.0:1787114869.873810:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 168 00000100:00100000:0.0:1787114869.873829:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+9:5579:x1873925602547328:12345-192.168.202.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787114869.873846:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114869.873864:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af052364c00/0x194cd781e88c8389 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d138a expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114869.873907:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af052364c00/0x194cd781e88c8389 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d138a expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114869.873918:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af052364c00/0x194cd781e88c8389 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d138a expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114869.873927:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052364c00, rc 0) 00000100:00100000:0.0:1787114869.874007:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:5579:x1873925602547328:12345-192.168.202.10@tcp:101:ll_cfg_requeue.0 Request processed in 165us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114869.874022:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 168 00000100:00100000:3.0:1787114869.876835:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114869.876931:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602547456 00000100:00100000:0.0:1787114869.876940:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602547456 00000100:00100000:3.0:1787114869.882554:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 169 00000100:00100000:3.0:1787114869.882573:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:5579:x1873925602547456:12345-192.168.202.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787114869.882857:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:5579:x1873925602547456:12345-192.168.202.10@tcp:501:ll_cfg_requeue.0 Request processed in 290us (6086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114869.882867:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 169 00000100:00100000:2.0:1787114869.887936:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114869.887975:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602547584 00000100:00100000:2.0:1787114869.887985:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602547584 00000100:00100000:2.0:1787114869.888032:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 170 00000100:00100000:2.0:1787114869.888042:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:5579:x1873925602547584:12345-192.168.202.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787114869.888364:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:5579:x1873925602547584:12345-192.168.202.10@tcp:503:ll_cfg_requeue.0 Request processed in 323us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114869.888373:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 170 00000100:00100000:1.0:1787114869.911602:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114869.912189:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602547712 00000100:00100000:2.0:1787114869.912199:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602547712 00000100:00100000:2.0:1787114869.912261:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 171 00000100:00100000:2.0:1787114869.912272:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:6110:x1873925602547712:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787114869.912519:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:6110:x1873925602547712:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 249us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114869.912527:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 171 00000100:00100000:3.0:1787114869.916928:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114869.917883:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602547840 00000100:00100000:2.0:1787114869.917894:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602547840 00000100:00100000:2.0:1787114869.917955:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 172 00000100:00100000:2.0:1787114869.917964:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:6110:x1873925602547840:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787114869.918267:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:6110:x1873925602547840:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 303us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114869.918276:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 172 00010000:00010000:0.0:1787114869.963873:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114870.138148:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114870.138189:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114870.138208:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114870.138244:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602547968 00000100:00100000:2.0:1787114870.138252:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602547968 00000100:00100000:2.0:1787114870.138307:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 31 00000100:00100000:2.0:1787114870.138315:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07398b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2363:x1873925602547968:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787114870.138377:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07398b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2363:x1873925602547968:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 63us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114870.138383:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 31 00000100:00100000:2.0:1787114870.138408:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602548096 00000100:00100000:2.0:1787114870.138411:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602548096 00000100:00100000:2.0:1787114870.138431:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602548224 00000100:00100000:2.0:1787114870.138433:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602548224 00000100:00100000:2.0:1787114870.138445:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15 00000100:00100000:2.0:1787114870.138450:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07398ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2364:x1873925602548096:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787114870.138471:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07398ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2364:x1873925602548096:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 21us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114870.138476:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15 00000100:00100000:2.0:1787114870.138501:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16 00000100:00100000:2.0:1787114870.138506:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2363:x1873925602548224:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787114870.138533:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2363:x1873925602548224:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 27us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114870.138539:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16 00000100:00080000:2.0:1787114870.138554:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787114870.138557:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787114870.138559:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:3.0:1787114870.726740:0:5782:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787114870.726746:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af07b581000 from 4 10000000:01000000:3.0:1787114870.726751:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787114870.726795:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429cae00/0x194cd781e88c8390 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114870.726807:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af0429cae00/0x194cd781e88c8390 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114870.726818:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af0429cae00/0x194cd781e88c8390 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114870.726844:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624595584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787114870.726916:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114870.726979:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042d2d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787114870.727197:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624595584 00000100:00100000:0.0:1787114870.727204:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624595584 00000100:00100000:0.0:1787114870.727262:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787114870.727271:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:5782:x1873925624595584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787114870.727284:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114870.727298:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af052364a00/0x194cd781e88c8397 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8390 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114870.727321:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af052364a00/0x194cd781e88c8397 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8390 expref: 17 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114870.727345:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af052364a00/0x194cd781e88c8397 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8390 expref: 17 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114870.727354:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052364a00, rc 0) 00000100:00100000:0.0:1787114870.727437:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624595584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114870.727444:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787114870.729402:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624595584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787114870.729425:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af0429cae00/0x194cd781e88c8390 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8397 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114870.729437:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af0429cae00/0x194cd781e88c8390 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8397 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114870.729525:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624595712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787114870.729576:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114870.729654:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af07b8e1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787114870.731556:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624595712 00000100:00100000:2.0:1787114870.731569:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624595712 00000100:00100000:2.0:1787114870.731658:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787114870.731668:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624595712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787114870.731947:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624595712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (2369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114870.731955:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787114870.732795:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624595712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787114870.732844:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624595840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787114870.732893:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114870.732924:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af07b8e1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787114870.732936:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624595840 00000100:00100000:1.0:1787114870.732940:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624595840 00000100:00100000:1.0:1787114870.732966:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787114870.732973:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624595840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787114870.733131:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624595840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114870.733139:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787114870.733177:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624595840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787114870.733388:0:8421:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8421:1873925624595968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787114870.733418:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114870.733434:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624595968 00000100:00100000:1.0:1787114870.733437:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624595968 00000100:00100000:1.0:1787114870.733454:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787114870.733460:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:8421:x1873925624595968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787114870.733573:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:8421:x1873925624595968:12345-0@lo:502:llog_process_th.0 Request processed in 112us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114870.733592:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787114870.733626:0:8421:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af07b8e1900 going to sleep for 11 seconds 00000100:00100000:1.0:1787114870.733637:0:8421:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8421:1873925624595968:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787114870.733655:0:8421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787114870.733665:0:8421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787114870.733668:0:8421:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787114870.733674:0:8421:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8af07b581000 00000020:00000080:1.0:1787114870.733677:0:8421:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787114870.735615:0:8421:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8421:1873925624596096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787114870.735687:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114870.735732:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624596096 00000100:00100000:1.0:1787114870.735738:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624596096 00000100:00100000:1.0:1787114870.735777:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787114870.735786:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:8421:x1873925624596096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787114870.735968:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:8421:x1873925624596096:12345-0@lo:502:llog_process_th.0 Request processed in 182us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114870.735976:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787114870.736026:0:8421:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045afe600 going to sleep for 11 seconds 00000100:00100000:1.0:1787114870.736046:0:8421:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8421:1873925624596096:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787114870.736071:0:8421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787114870.736079:0:8421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787114870.736081:0:8421:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787114870.736086:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787114870.736173:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787114870.736191:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787114870.736201:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429cae00/0x194cd781e88c8390 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8397 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114870.736217:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af0429cae00/0x194cd781e88c8390 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8397 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787114870.736227:0:5782:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787114870.736298:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af06f41d000 from 4 10000000:01000000:1.0:1787114870.736301:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787114870.736325:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c839e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114870.736333:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c839e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114870.736344:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c839e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114870.736357:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624596224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787114870.736384:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114870.736404:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042c68900 going to sleep for 11 seconds 00000100:00100000:1.0:1787114870.736415:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624596224 00000100:00100000:1.0:1787114870.736419:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624596224 00000100:00100000:1.0:1787114870.736439:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787114870.736446:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624596224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787114870.736454:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787114870.736465:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af041682200/0x194cd781e88c83a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c839e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114870.736487:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af041682200/0x194cd781e88c83a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c839e expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114870.736510:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af041682200/0x194cd781e88c83a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c839e expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114870.736519:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041682200, rc 0) 00000100:00100000:1.0:1787114870.736548:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624596224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114870.736554:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787114870.736586:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624596224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787114870.736599:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c839e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c83a5 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114870.736608:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c839e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c83a5 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114870.736647:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624596352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787114870.736671:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114870.736684:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042c68900 going to sleep for 11 seconds 00000100:00100000:1.0:1787114870.736695:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624596352 00000100:00100000:1.0:1787114870.736698:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624596352 00000100:00100000:1.0:1787114870.736718:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787114870.736724:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624596352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787114870.736920:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624596352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 196us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114870.736927:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787114870.736956:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624596352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787114870.736989:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624596480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787114870.737020:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114870.737034:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042c68900 going to sleep for 11 seconds 00000100:00100000:1.0:1787114870.737046:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624596480 00000100:00100000:1.0:1787114870.737049:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624596480 00000100:00100000:1.0:1787114870.737069:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787114870.737075:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624596480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787114870.737205:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624596480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114870.737212:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787114870.737318:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624596480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787114870.737564:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8423:1873925624596608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787114870.737596:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114870.737616:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624596608 00000100:00100000:1.0:1787114870.737620:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624596608 00000100:00100000:1.0:1787114870.737640:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787114870.737646:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:8423:x1873925624596608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787114870.737755:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:8423:x1873925624596608:12345-0@lo:502:llog_process_th.0 Request processed in 108us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114870.737762:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787114870.737796:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042c680c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787114870.737808:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8423:1873925624596608:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787114870.737827:0:8423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787114870.737835:0:8423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787114870.737843:0:8423:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787114870.737850:0:8423:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8af06f41d000 00000020:00000080:1.0:1787114870.737852:0:8423:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787114870.737934:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8423:1873925624596736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787114870.737968:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114870.737987:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624596736 00000100:00100000:1.0:1787114870.737991:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624596736 00000100:00100000:1.0:1787114870.738012:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787114870.738018:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:8423:x1873925624596736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787114870.738151:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:8423:x1873925624596736:12345-0@lo:502:llog_process_th.0 Request processed in 133us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114870.738158:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787114870.738194:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042c680c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787114870.738207:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8423:1873925624596736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787114870.738227:0:8423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787114870.738246:0:8423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787114870.738248:0:8423:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787114870.738252:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787114870.738288:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787114870.738305:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787114870.738311:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c839e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c83a5 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114870.738321:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c839e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c83a5 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787114870.738331:0:5782:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787114870.738333:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af05032f000 from 4 10000000:01000000:1.0:1787114870.738335:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787114870.738364:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c83ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114870.738373:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c83ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114870.738381:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c83ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114870.738394:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624596864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787114870.738418:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114870.738435:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042c680c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787114870.738447:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624596864 00000100:00100000:1.0:1787114870.738450:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624596864 00000100:00100000:1.0:1787114870.738471:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787114870.738477:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624596864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787114870.738484:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787114870.738494:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af041683000/0x194cd781e88c83b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c83ac expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114870.738511:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af041683000/0x194cd781e88c83b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c83ac expref: 19 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114870.738519:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af041683000/0x194cd781e88c83b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c83ac expref: 19 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114870.738527:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041683000, rc 0) 00000100:00100000:1.0:1787114870.738556:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:5782:x1873925624596864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114870.738562:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787114870.738599:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624596864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787114870.738610:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c83ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c83b3 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114870.738618:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c83ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c83b3 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114870.738654:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624596992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787114870.738678:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114870.738690:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042c680c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787114870.738701:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624596992 00000100:00100000:1.0:1787114870.738705:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624596992 00000100:00100000:1.0:1787114870.738724:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787114870.738730:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:5782:x1873925624596992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787114870.738894:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:5782:x1873925624596992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114870.738901:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787114870.738933:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624596992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787114870.738957:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624597120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787114870.739002:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114870.739014:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042c680c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787114870.739025:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624597120 00000100:00100000:1.0:1787114870.739028:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624597120 00000100:00100000:1.0:1787114870.739050:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787114870.739057:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:5782:x1873925624597120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787114870.739200:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:5782:x1873925624597120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114870.739212:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787114870.739320:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624597120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787114870.743978:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8424:1873925624597248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787114870.744214:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114870.744271:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624597248 00000100:00100000:0.0:1787114870.744277:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af07f80ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1787114870.744280:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624597248 00000100:00100000:1.0:1787114870.744333:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787114870.744342:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:8424:x1873925624597248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787114870.744548:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:8424:x1873925624597248:12345-0@lo:502:llog_process_th.0 Request processed in 206us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114870.744557:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787114870.744566:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8424:1873925624597248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787114870.744605:0:8424:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787114870.744617:0:8424:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787114870.744620:0:8424:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787114870.744627:0:8424:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8af05032f000 00000020:00000080:0.0:1787114870.744630:0:8424:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787114870.746315:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8424:1873925624597376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787114870.746379:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114870.746745:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042d2de40 going to sleep for 11 seconds 00000100:00100000:2.0:1787114870.747088:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624597376 00000100:00100000:2.0:1787114870.747096:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624597376 00000100:00100000:2.0:1787114870.747167:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787114870.747177:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:8424:x1873925624597376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787114870.748615:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:8424:x1873925624597376:12345-0@lo:502:llog_process_th.0 Request processed in 1437us (2232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114870.748627:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787114870.750635:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:8424:1873925624597376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787114870.750697:0:8424:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787114870.750704:0:8424:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787114870.750707:0:8424:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787114870.750711:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787114870.751513:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787114870.751536:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787114870.751547:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c83ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c83b3 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114870.751559:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c83ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c83b3 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114870.983244:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114871.695880:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624597504:0@lo:400:kworker.0 00000100:00100000:1.0:1787114871.695951:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114871.696008:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624598016:0@lo:400:kworker.0 00000100:00100000:1.0:1787114871.696032:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114871.696057:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787114871.696062:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624597632:0@lo:400:kworker.0 00000100:00100000:1.0:1787114871.696082:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114871.696098:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624598144:0@lo:400:kworker.0 00000100:00100000:1.0:1787114871.696140:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114871.696205:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624597760:0@lo:400:kworker.0 00000100:00100000:1.0:1787114871.696255:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114871.696273:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787114871.696278:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624597888:0@lo:400:kworker.0 00000100:00100000:1.0:1787114871.696298:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114871.696327:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624597504 00000100:00100000:1.0:1787114871.696334:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624597504 00000100:00100000:1.0:1787114871.696376:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787114871.696383:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624597504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114871.696439:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624597504:12345-0@lo:400:kworker.0 Request processed in 46us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114871.696447:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787114871.696478:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624598016 00000100:00100000:1.0:1787114871.696481:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624598016 00000100:00100000:1.0:1787114871.696513:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624597632 00000100:00100000:1.0:1787114871.696515:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624597632 00000100:00100000:1.0:1787114871.696525:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624597760 00000100:00100000:1.0:1787114871.696527:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624597760 00000100:00100000:1.0:1787114871.696537:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787114871.696542:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624598016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114871.696569:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624598016:12345-0@lo:400:kworker.0 Request processed in 27us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114871.696574:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787114871.696583:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787114871.696588:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624597632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114871.696605:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624597632:12345-0@lo:400:kworker.0 Request processed in 17us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114871.696610:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787114871.696624:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787114871.696628:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624597760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114871.696652:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624597760:12345-0@lo:400:kworker.0 Request processed in 23us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114871.696657:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787114871.696671:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624598144 00000100:00100000:1.0:1787114871.696674:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624598144 00000100:00100000:1.0:1787114871.696692:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624597888 00000100:00100000:1.0:1787114871.696694:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624597888 00000100:00100000:1.0:1787114871.696704:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787114871.696708:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624598144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114871.696729:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624598144:12345-0@lo:400:kworker.0 Request processed in 21us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114871.696734:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787114871.696741:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787114871.696745:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051363100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624597888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114871.696764:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051363100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624597888:12345-0@lo:400:kworker.0 Request processed in 19us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114871.696769:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787114871.696805:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af073aeca80 x1873925624597888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114871.696817:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624597888:0@lo:400:kworker.0 00000100:00100000:1.0:1787114871.696826:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624597760:0@lo:400:kworker.0 00000100:00100000:1.0:1787114871.696846:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624597632:0@lo:400:kworker.0 00010000:00080000:1.0:1787114871.696854:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af073aedc00 x1873925624598144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114871.696867:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624598144:0@lo:400:kworker.0 00000100:00100000:1.0:1787114871.696874:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624597504:0@lo:400:kworker.0 00000100:00100000:1.0:1787114871.696881:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624598016:0@lo:400:kworker.0 00000100:00080000:3.0:1787114871.697784:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787114871.697791:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787114871.697793:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787114871.703255:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624598272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787114871.703405:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114871.709890:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624598272 00000100:00100000:2.0:1787114871.709910:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624598272 00000100:00100000:2.0:1787114871.710008:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787114871.710018:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624598272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787114871.710079:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787114871.710205:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624598272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 188us (6799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114871.710213:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787114871.710280:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af073988000 x1873925624598272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114871.710303:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624598272:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787114872.005416:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114872.198336:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787114872.198360:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624598400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787114872.198433:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114872.198643:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624598400 00000100:00100000:0.0:1787114872.198662:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624598400 00000100:00100000:0.0:1787114872.198714:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787114872.198723:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624598400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787114872.198759:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787114872.198879:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624598400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114872.198887:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1787114872.199714:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af06c158380 x1873925624598400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114872.199734:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624598400:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787114873.031804:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114874.125137:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787114875.146166:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787114875.259527:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114875.266018:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602548352 00000100:00100000:3.0:1787114875.266035:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602548352 00000100:00100000:3.0:1787114875.266093:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 189 00000100:00100000:3.0:1787114875.266103:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2361:x1873925602548352:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787114875.266213:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2361:x1873925602548352:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 111us (6701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114875.266222:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 189 00000100:00100000:3.0:1787114875.266296:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114875.266425:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114875.266449:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114875.266470:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602548608 00000100:00100000:3.0:1787114875.266474:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602548608 00000100:00100000:3.0:1787114875.266507:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602548736 00000100:00100000:3.0:1787114875.266510:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602548736 00000100:00100000:3.0:1787114875.266525:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00100000:3.0:1787114875.266532:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2361:x1873925602548608:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787114875.270817:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2361:x1873925602548608:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 4272us (4507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114875.270833:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00100000:3.0:1787114875.270884:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 20 00000100:00100000:3.0:1787114875.270899:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2361:x1873925602548736:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787114875.270972:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2361:x1873925602548736:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 79us (4522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114875.270979:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 20 00000100:00100000:3.0:1787114875.271008:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602548480 00000100:00100000:3.0:1787114875.271015:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602548480 00000100:00100000:3.0:1787114875.271066:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 35 00000100:00100000:3.0:1787114875.271073:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2361:x1873925602548480:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787114875.271101:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2361:x1873925602548480:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 28us (4676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114875.271123:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 35 00000100:00080000:3.0:1787114875.271141:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787114875.271145:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787114875.271148:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787114876.167083:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114876.805458:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787114876.805481:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07398b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624598528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787114876.805544:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114876.805618:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624598528 00000100:00100000:2.0:1787114876.805627:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624598528 00000100:00100000:2.0:1787114876.805686:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787114876.805696:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624598528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787114876.805735:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787114876.805780:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624598528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114876.805788:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787114876.805808:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787114876.805848:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07398b100 x1873925624598528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114876.805866:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07398b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624598528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787114876.807813:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c15a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624598912:0@lo:400:kworker.0 00000100:00100000:0.0:1787114876.807868:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114876.807918:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787114876.807925:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624598784:0@lo:400:kworker.0 00000100:00100000:0.0:1787114876.807949:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114876.807978:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624598912 00000100:00100000:0.0:1787114876.807985:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624598912 00000100:00100000:0.0:1787114876.808026:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624598784 00000100:00100000:0.0:1787114876.808029:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624598784 00000100:00100000:0.0:1787114876.808046:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787114876.808053:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624598912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114876.808095:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624598912:12345-0@lo:400:kworker.0 Request processed in 42us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114876.808102:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787114876.808140:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787114876.808146:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624598784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114876.808183:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624598784:12345-0@lo:400:kworker.0 Request processed in 27us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114876.808190:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787114876.808218:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624599040:0@lo:400:kworker.0 00000100:00100000:0.0:1787114876.808241:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114876.808264:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787114876.808270:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624598656:0@lo:400:kworker.0 00000100:00100000:0.0:1787114876.808293:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114876.808313:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624599168:0@lo:400:kworker.0 00000100:00100000:0.0:1787114876.808460:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114876.808491:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624598656 00000100:00100000:0.0:1787114876.808494:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624598656 00000100:00100000:0.0:1787114876.808519:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787114876.808524:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624598656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114876.808556:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624598656:12345-0@lo:400:kworker.0 Request processed in 31us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114876.808562:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787114876.808587:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624599168 00000100:00100000:0.0:1787114876.808590:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624599168 00000100:00100000:0.0:1787114876.808614:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787114876.808620:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624599168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114876.808648:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624599168:12345-0@lo:400:kworker.0 Request processed in 28us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114876.808653:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787114876.808688:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624598784:0@lo:400:kworker.0 00000100:00100000:0.0:1787114876.808698:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c15a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624598912:0@lo:400:kworker.0 00000100:00100000:0.0:1787114876.808722:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624598656:0@lo:400:kworker.0 00010000:00080000:0.0:1787114876.808734:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af06c15b800 x1873925624599168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114876.808743:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624599168:0@lo:400:kworker.0 00000100:00100000:0.0:1787114876.808757:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624599040 00000100:00100000:0.0:1787114876.808760:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624599040 00000100:00100000:0.0:1787114876.808782:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787114876.808788:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624599040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114876.808827:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624599040:12345-0@lo:400:kworker.0 Request processed in 39us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114876.808834:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787114876.808859:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624599040:0@lo:400:kworker.0 00000100:00080000:2.0:1787114876.809095:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787114876.809100:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787114877.194715:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114877.320368:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624599296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787114877.320445:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114877.320524:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624599296 00000100:00100000:0.0:1787114877.320534:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624599296 00000100:00100000:0.0:1787114877.320583:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787114877.320592:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624599296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787114877.320629:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787114877.320674:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624599296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114877.320682:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787114877.320724:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07fb97800 x1873925624599296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114877.320744:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624599296:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787114878.214016:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787114878.250764:0:8646:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg210-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1787114879.237303:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114880.273155:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114880.381088:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114880.381201:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114880.381327:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602548992 00000100:00100000:1.0:1787114880.381344:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602548992 00000100:00100000:1.0:1787114880.381428:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 39 00000100:00100000:1.0:1787114880.381439:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07398b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602548992:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114880.381512:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07398b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602548992:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 75us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114880.381520:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 39 00000100:00100000:0.0:1787114880.383003:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602548864 00000100:00100000:0.0:1787114880.383023:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602548864 00000100:00100000:0.0:1787114880.383081:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 191 00000100:00100000:0.0:1787114880.383089:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2364:x1873925602548864:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787114880.383191:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2364:x1873925602548864:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 103us (2113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114880.383217:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 191 00000100:00080000:2.0:1787114880.383961:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787114880.394500:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114880.394543:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114880.394619:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602549120 00000100:00100000:0.0:1787114880.394633:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602549120 00000100:00080000:2.0:1787114880.394796:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787114880.394836:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602549248 00000100:00100000:0.0:1787114880.394841:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602549248 00000100:00080000:2.0:1787114880.394891:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787114880.394929:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 10 00000100:00100000:1.0:1787114880.394942:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2360:x1873925602549120:12345-192.168.202.10@tcp:9:kworker.0 00000020:00000080:1.0:1787114880.395049:0:6578:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c82ef 00000100:00080000:1.0:1787114880.395062:0:6578:0:(import.c:65:import_set_state_nolock()) ffff8af06f4bb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787114880.395170:0:6578:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787114880.395644:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+2:2360:x1873925602549120:12345-192.168.202.10@tcp:9:kworker.0 Request processed in 704us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114880.395654:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 10 00000100:00100000:1.0:1787114880.395673:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00100000:1.0:1787114880.395680:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07398aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2360:x1873925602549248:12345-192.168.202.10@tcp:9:kworker.0 00000020:00000080:1.0:1787114880.395696:0:6578:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c82f6 00000100:00080000:1.0:1787114880.395704:0:6578:0:(import.c:65:import_set_state_nolock()) ffff8af06f4be000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787114880.395921:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1787114880.396074:0:6578:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787114880.396444:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07398aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+2:2360:x1873925602549248:12345-192.168.202.10@tcp:9:kworker.0 Request processed in 762us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114880.396451:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11 00010000:00010000:2.0:1787114880.396668:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787114880.962595:0:6604:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6aef9ffe-3b7b-498c-9a5a-a012c6970297 00000020:00000080:1.0:1787114880.962605:0:6604:0:(genops.c:906:class_export_put()) final put ffff8af06f4b8000/6aef9ffe-3b7b-498c-9a5a-a012c6970297 00000020:00000080:2.0:1787114880.963998:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8af06f4b8000/6aef9ffe-3b7b-498c-9a5a-a012c6970297 for lustre-OST0000 00000020:00000080:2.0:1787114880.964062:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af06f4bb800 for lustre-OST0000 00010000:00010000:3.0:1787114881.288410:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114881.926212:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07398a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624599424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787114881.926280:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114881.926373:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624599424 00000100:00100000:0.0:1787114881.926381:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624599424 00000100:00100000:0.0:1787114881.926432:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787114881.926439:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624599424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787114881.926474:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787114881.926514:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624599424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114881.926521:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787114881.926539:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787114881.926568:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07398a680 x1873925624599424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114881.926585:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07398a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624599424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787114881.926807:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624599680:0@lo:400:kworker.0 00000100:00100000:2.0:1787114881.926837:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114881.926854:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787114881.926859:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624599552:0@lo:400:kworker.0 00000100:00100000:2.0:1787114881.926881:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114881.926910:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624600064:0@lo:400:kworker.0 00000100:00100000:2.0:1787114881.926930:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114881.928719:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624599680 00000100:00100000:0.0:1787114881.928729:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624599680 00000100:00100000:0.0:1787114881.928781:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787114881.928789:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07398a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624599680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114881.928854:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07398a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624599680:12345-0@lo:400:kworker.0 Request processed in 65us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114881.928861:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787114881.928905:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624599552 00000100:00100000:0.0:1787114881.928909:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624599552 00000100:00100000:0.0:1787114881.928931:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787114881.928937:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624599552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114881.928966:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624599552:12345-0@lo:400:kworker.0 Request processed in 29us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114881.928971:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787114881.928996:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624600064 00000100:00100000:0.0:1787114881.929000:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624600064 00000100:00100000:0.0:1787114881.929028:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787114881.929034:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624600064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114881.929074:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624600064:12345-0@lo:400:kworker.0 Request processed in 40us (2142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114881.929080:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1787114881.929099:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787114881.929144:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07398a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873925624599936:0@lo:400:kworker.0 00000100:00100000:0.0:1787114881.929171:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114881.929192:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787114881.929199:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624599808:0@lo:400:kworker.0 00000100:00100000:0.0:1787114881.929218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114881.929241:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624599936 00000100:00100000:0.0:1787114881.929244:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624599936 00000100:00100000:0.0:1787114881.929264:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624599808 00000100:00100000:0.0:1787114881.929266:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624599808 00000100:00100000:0.0:1787114881.929278:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787114881.929282:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873925624599936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114881.929324:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873925624599936:12345-0@lo:400:kworker.0 Request processed in 41us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114881.929336:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787114881.929347:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787114881.929352:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624599808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114881.929388:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624599808:12345-0@lo:400:kworker.0 Request processed in 36us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114881.929393:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1787114881.929407:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787114881.929429:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624599808:0@lo:400:kworker.0 00000100:00100000:0.0:1787114881.929438:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07398a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873925624599936:0@lo:400:kworker.0 00000100:00100000:3.0:1787114881.929734:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624599552:0@lo:400:kworker.0 00010000:00080000:3.0:1787114881.929748:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af073989180 x1873925624600064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114881.929759:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624600064:0@lo:400:kworker.0 00000100:00100000:3.0:1787114881.929778:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624599680:0@lo:400:kworker.0 00010000:00010000:0.0:1787114882.309963:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114882.437598:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787114882.437629:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624600192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787114882.437709:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114882.437793:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624600192 00000100:00100000:0.0:1787114882.437809:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624600192 00000100:00100000:0.0:1787114882.437889:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787114882.437977:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624600192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787114882.438029:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1787114882.438269:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af06c158e00 x1873925624600192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114882.438294:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624600192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787114882.438532:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624600192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 557us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114882.438543:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787114883.345705:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114884.364668:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787114884.662597:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6aef9ffe-3b7b-498c-9a5a-a012c6970297 00000020:00000080:2.0:1787114884.662612:0:7483:0:(genops.c:906:class_export_put()) final put ffff8af06f4b9000/6aef9ffe-3b7b-498c-9a5a-a012c6970297 00000020:00000080:2.0:1787114884.662853:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8af06f4b9000/6aef9ffe-3b7b-498c-9a5a-a012c6970297 for lustre-OST0001 00000020:00000080:2.0:1787114884.662911:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af06f4be000 for lustre-OST0001 00010000:00010000:0.0:1787114885.381589:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114885.509351:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114885.509509:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602549376 00000100:00100000:1.0:1787114885.509521:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602549376 00000100:00100000:0.0:1787114885.509525:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114885.509549:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602549504 00000100:00100000:0.0:1787114885.509552:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602549504 00000100:00100000:1.0:1787114885.509583:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 193 00000100:00100000:0.0:1787114885.509590:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 43 00000100:00100000:1.0:1787114885.509593:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2361:x1873925602549376:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787114885.509595:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c15b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2361:x1873925602549504:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114885.509668:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2361:x1873925602549376:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 76us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114885.509676:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 193 00000100:00100000:0.0:1787114885.510294:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c15b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2361:x1873925602549504:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 696us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114885.510304:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 43 00000100:00080000:0.0:1787114885.510325:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787114886.407166:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114887.047191:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624600448:0@lo:400:kworker.0 00000100:00100000:3.0:1787114887.047384:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624600320:0@lo:400:kworker.0 00000100:00100000:3.0:1787114887.054721:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114887.054801:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624600832:0@lo:400:kworker.0 00000100:00100000:3.0:1787114887.054856:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114887.055664:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624600320 00000100:00100000:3.0:1787114887.055676:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624600320 00000100:00100000:3.0:1787114887.055733:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787114887.055742:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624600320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114887.055801:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624600320:12345-0@lo:400:kworker.0 Request processed in 60us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114887.055809:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787114887.056739:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114887.056773:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624600960:0@lo:400:kworker.0 00000100:00100000:2.0:1787114887.056809:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114887.056865:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624600576:0@lo:400:kworker.0 00000100:00100000:2.0:1787114887.056891:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114887.056911:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624601088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787114887.056944:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114887.056968:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787114887.056975:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07398a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624600704:0@lo:400:kworker.0 00000100:00100000:2.0:1787114887.056995:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114887.057345:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624600320:0@lo:400:kworker.0 00000100:00100000:0.0:1787114887.061623:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624600832 00000100:00100000:0.0:1787114887.061640:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624600832 00000100:00100000:0.0:1787114887.061705:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624600448 00000100:00100000:0.0:1787114887.061709:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624600448 00000100:00100000:0.0:1787114887.061723:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624600576 00000100:00100000:0.0:1787114887.061725:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624600576 00000100:00100000:0.0:1787114887.061743:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787114887.061752:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624600832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114887.061864:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624600832:12345-0@lo:400:kworker.0 Request processed in 112us (7007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114887.061871:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787114887.061886:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787114887.061892:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624600448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114887.062846:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624600448:12345-0@lo:400:kworker.0 Request processed in 951us (6107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114887.062855:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787114887.062873:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787114887.062882:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624600576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114887.067949:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624600576:12345-0@lo:400:kworker.0 Request processed in 5048us (11035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114887.067966:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1787114887.068025:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787114887.072911:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624600832:0@lo:400:kworker.0 00000100:00100000:2.0:1787114887.073212:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624600448:0@lo:400:kworker.0 00000100:00100000:2.0:1787114887.073307:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624600960 00000100:00100000:2.0:1787114887.073315:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624600960 00000100:00100000:2.0:1787114887.073405:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624600704 00000100:00100000:2.0:1787114887.073409:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624600704 00000100:00100000:2.0:1787114887.073430:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787114887.073449:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624600960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114887.073543:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624600960:12345-0@lo:400:kworker.0 Request processed in 96us (16733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114887.073551:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787114887.073566:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787114887.073573:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624600704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114887.073615:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624600704:12345-0@lo:400:kworker.0 Request processed in 42us (16618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114887.073621:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787114887.073645:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624601088 00000100:00100000:2.0:1787114887.073649:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624601088 00000100:00100000:2.0:1787114887.073672:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787114887.073677:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624601088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787114887.073704:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787114887.073736:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624601088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (16791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114887.073742:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1787114887.073773:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f7d5f80 x1873925624600960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114887.073784:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624600960:0@lo:400:kworker.0 00000100:00080000:3.0:1787114887.078045:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787114887.078055:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787114887.078579:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07398a680 x1873925624600704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114887.078899:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07398a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624600704:0@lo:400:kworker.0 00000100:00100000:0.0:1787114887.078917:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624600576:0@lo:400:kworker.0 00010000:00080000:0.0:1787114887.078927:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af051362a00 x1873925624601088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114887.078950:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624601088:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787114887.430267:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114887.560771:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624601216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787114887.560889:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114887.561141:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624601216 00000100:00100000:3.0:1787114887.561150:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624601216 00000100:00100000:3.0:1787114887.561230:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787114887.561240:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624601216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787114887.561302:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787114887.561377:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624601216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114887.561390:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787114887.561466:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af06eb70700 x1873925624601216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114887.561493:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624601216:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787114888.457889:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787114888.541870:0:8893:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg210-server.virtnet: executing yml_node 00010000:00010000:3.0:1787114889.507661:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114890.580389:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114890.625957:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114890.626033:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114890.626929:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602549632 00000100:00100000:1.0:1787114890.626940:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602549632 00000100:00100000:1.0:1787114890.626994:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 195 00000100:00100000:1.0:1787114890.627002:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2361:x1873925602549632:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114890.627085:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2361:x1873925602549632:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 82us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114890.627092:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 195 00000100:00100000:3.0:1787114890.627591:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602549760 00000100:00100000:3.0:1787114890.627596:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602549760 00000100:00080000:0.0:1787114890.627875:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787114890.641386:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 47 00000100:00100000:3.0:1787114890.641405:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c15a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2361:x1873925602549760:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787114890.641493:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c15a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2361:x1873925602549760:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 96us (15459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114890.641500:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 47 00010000:00010000:1.0:1787114891.589745:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787114892.165639:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624601344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787114892.165714:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114892.166149:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624601600:0@lo:400:kworker.0 00000100:00100000:1.0:1787114892.166182:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114892.166201:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787114892.166224:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624601728:0@lo:400:kworker.0 00000100:00100000:1.0:1787114892.166248:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114892.166852:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624601856:0@lo:400:kworker.0 00000100:00100000:3.0:1787114892.166889:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114892.166930:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787114892.166937:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624601472:0@lo:400:kworker.0 00000100:00100000:3.0:1787114892.166966:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114892.166988:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624601984:0@lo:400:kworker.0 00000100:00100000:3.0:1787114892.167011:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114892.167049:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624601472 00000100:00100000:3.0:1787114892.167058:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624601472 00000100:00100000:3.0:1787114892.167226:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787114892.167236:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624601472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114892.167410:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624601472:12345-0@lo:400:kworker.0 Request processed in 175us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114892.167418:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787114892.167464:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624601472:0@lo:400:kworker.0 00000100:00100000:2.0:1787114892.167586:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624601600 00000100:00100000:2.0:1787114892.167591:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624601600 00000100:00100000:2.0:1787114892.167657:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624601728 00000100:00100000:2.0:1787114892.167661:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624601728 00000100:00100000:2.0:1787114892.167683:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624601856 00000100:00100000:2.0:1787114892.167685:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624601856 00000100:00100000:2.0:1787114892.167708:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787114892.167713:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624601600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114892.167752:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624601600:12345-0@lo:400:kworker.0 Request processed in 39us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114892.167759:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787114892.167770:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787114892.167776:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624601728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114892.167799:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624601728:12345-0@lo:400:kworker.0 Request processed in 24us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114892.167805:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787114892.167814:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787114892.167819:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624601856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114892.167842:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624601856:12345-0@lo:400:kworker.0 Request processed in 23us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114892.167849:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787114892.167869:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624601984 00000100:00100000:2.0:1787114892.167872:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624601984 00000100:00100000:2.0:1787114892.167896:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787114892.167901:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624601984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114892.167928:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624601984:12345-0@lo:400:kworker.0 Request processed in 27us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114892.167933:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1787114892.167950:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787114892.167955:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787114892.167979:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624601728:0@lo:400:kworker.0 00000100:00100000:2.0:1787114892.167989:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624601600:0@lo:400:kworker.0 00010000:00080000:3.0:1787114892.168071:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af073aee680 x1873925624601984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114892.168081:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624601984:0@lo:400:kworker.0 00000100:00100000:3.0:1787114892.168090:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624601856:0@lo:400:kworker.0 00000100:00100000:0.0:1787114892.168272:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624601344 00000100:00100000:0.0:1787114892.168276:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624601344 00000100:00100000:0.0:1787114892.168475:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787114892.168491:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624601344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787114892.168518:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787114892.168578:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624601344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (2864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114892.168583:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787114892.170543:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787114892.170715:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af051362680 x1873925624601344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114892.170741:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624601344:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787114892.613525:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114892.678832:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624602112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787114892.678909:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114892.679131:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624602112 00000100:00100000:3.0:1787114892.679140:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624602112 00000100:00100000:3.0:1787114892.679193:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787114892.679202:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624602112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787114892.679239:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787114892.679293:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624602112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114892.679309:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787114892.679501:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af06eb71500 x1873925624602112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114892.679520:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624602112:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787114893.637619:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787114894.604870:0:9085:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.56.3 00010000:00010000:0.0:1787114894.661585:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114895.685440:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114895.741549:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114895.741586:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114895.741651:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602550016 00000100:00100000:3.0:1787114895.741661:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602550016 00000100:00100000:3.0:1787114895.741728:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 51 00000100:00100000:3.0:1787114895.741739:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602550016:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787114895.741836:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602550016:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 99us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114895.741844:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 51 00000100:00080000:0.0:1787114895.741991:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787114895.742096:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602549888 00000100:00100000:2.0:1787114895.742101:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602549888 00000100:00100000:2.0:1787114895.742170:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 197 00000100:00100000:2.0:1787114895.742178:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2364:x1873925602549888:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787114895.742220:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2364:x1873925602549888:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 42us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114895.742227:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 197 00010000:00010000:1.0:1787114896.712796:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114897.285357:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624602624:0@lo:400:kworker.0 00000100:00100000:1.0:1787114897.285437:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114897.285490:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787114897.285496:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624602240:0@lo:400:kworker.0 00000100:00100000:1.0:1787114897.285533:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114897.285733:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624602752:0@lo:400:kworker.0 00000100:00100000:1.0:1787114897.285760:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114897.285791:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624602624 00000100:00100000:1.0:1787114897.285798:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624602624 00000100:00100000:1.0:1787114897.285856:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787114897.285865:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624602624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114897.285915:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624602624:12345-0@lo:400:kworker.0 Request processed in 50us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114897.285922:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787114897.285946:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624602240 00000100:00100000:1.0:1787114897.285949:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624602240 00000100:00100000:1.0:1787114897.285974:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787114897.286289:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624602368:0@lo:400:kworker.0 00000100:00100000:3.0:1787114897.286322:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114897.286343:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624602880:0@lo:400:kworker.0 00000100:00100000:3.0:1787114897.286365:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114897.286384:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787114897.286390:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624602496:0@lo:400:kworker.0 00000100:00100000:3.0:1787114897.286423:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114897.286466:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624602752 00000100:00100000:3.0:1787114897.286470:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624602752 00000100:00100000:3.0:1787114897.286498:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624602368 00000100:00100000:3.0:1787114897.286500:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624602368 00000100:00100000:3.0:1787114897.286510:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624602496 00000100:00100000:3.0:1787114897.286512:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624602496 00000100:00100000:3.0:1787114897.286524:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787114897.286529:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624602752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114897.287215:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624603008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787114897.287280:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114897.287371:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624602240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114897.287457:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624602240:12345-0@lo:400:kworker.0 Request processed in 45us (1877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114897.287465:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787114897.287512:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787114897.287526:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624602368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114897.287712:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624602752:12345-0@lo:400:kworker.0 Request processed in 1181us (1949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114897.287718:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787114897.287733:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787114897.287739:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624602496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114897.287763:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624602496:12345-0@lo:400:kworker.0 Request processed in 24us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114897.287768:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787114897.287793:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624602880 00000100:00100000:3.0:1787114897.287799:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624602880 00000100:00100000:3.0:1787114897.287866:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787114897.287873:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624602880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114897.287903:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624602880:12345-0@lo:400:kworker.0 Request processed in 31us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114897.287909:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787114897.287952:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624602368:12345-0@lo:400:kworker.0 Request processed in 428us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114897.287959:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1787114897.287975:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787114897.287994:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787114897.287997:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787114897.291208:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624602240:0@lo:400:kworker.0 00000100:00100000:0.0:1787114897.291231:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624602752:0@lo:400:kworker.0 00010000:00080000:0.0:1787114897.291247:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af073aeea00 x1873925624602624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114897.291258:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624602624:0@lo:400:kworker.0 00000100:00100000:3.0:1787114897.296556:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624603008 00000100:00100000:3.0:1787114897.296571:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624603008 00000100:00100000:3.0:1787114897.296627:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787114897.296637:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624603008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787114897.296681:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787114897.296764:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624603008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (9483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114897.296771:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787114897.296822:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af06c158e00 x1873925624603008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114897.296843:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624603008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787114897.296883:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624602496:0@lo:400:kworker.0 00000100:00100000:3.0:1787114897.296896:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624602368:0@lo:400:kworker.0 00010000:00080000:3.0:1787114897.296909:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af0591d5f80 x1873925624602880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114897.296918:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624602880:0@lo:400:kworker.0 00000001:02000400:2.0:1787114897.350669:0:9182:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.56.3 00010000:00010000:0.0:1787114897.736868:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114897.800365:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787114897.800389:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624603136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787114897.800458:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114897.800555:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624603136 00000100:00100000:3.0:1787114897.800563:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624603136 00000100:00100000:3.0:1787114897.801243:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787114897.801256:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624603136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787114897.801292:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787114897.801350:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624603136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114897.801357:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787114897.802070:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af06eb71f80 x1873925624603136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114897.802092:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624603136:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787114898.758009:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787114899.677362:0:9280:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.56.3 00010000:00010000:2.0:1787114899.782321:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114900.808983:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114900.858577:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114900.858620:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114900.858651:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602550272 00000100:00100000:1.0:1787114900.858659:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602550272 00000100:00100000:1.0:1787114900.858716:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 55 00000100:00100000:1.0:1787114900.858727:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602550272:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114900.858797:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602550272:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 72us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114900.858804:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 55 00000100:00080000:1.0:1787114900.858823:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787114900.863317:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602550144 00000100:00100000:2.0:1787114900.863341:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602550144 00000100:00100000:2.0:1787114900.863409:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 199 00000100:00100000:2.0:1787114900.863432:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2364:x1873925602550144:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787114900.863512:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2364:x1873925602550144:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 82us (4944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114900.863519:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 199 00000001:02000400:1.0:1787114901.048233:0:9328:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Aug 19 00:48:20 EDT 2026 00010000:00010000:1.0:1787114901.833524:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114902.405380:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b68d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624603264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787114902.405485:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114902.405598:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624603264 00000100:00100000:0.0:1787114902.405608:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624603264 00000100:00100000:0.0:1787114902.405676:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787114902.405685:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624603264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787114902.405733:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787114902.405789:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624603264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114902.405797:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787114902.405825:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787114902.405858:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07b68d180 x1873925624603264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114902.405879:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b68d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624603264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787114902.406237:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624603520:0@lo:400:kworker.0 00000100:00100000:1.0:1787114902.406278:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114902.406312:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787114902.406318:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624603392:0@lo:400:kworker.0 00000100:00100000:1.0:1787114902.406346:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114902.406366:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624603904:0@lo:400:kworker.0 00000100:00100000:1.0:1787114902.406402:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114902.406457:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624603520 00000100:00100000:3.0:1787114902.406462:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624603520 00000100:00100000:3.0:1787114902.406505:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787114902.406514:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624603520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114902.406558:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624603520:12345-0@lo:400:kworker.0 Request processed in 45us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114902.406563:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787114902.406590:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624603520:0@lo:400:kworker.0 00000100:00100000:0.0:1787114902.406763:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624603392 00000100:00100000:0.0:1787114902.406769:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624603392 00000100:00100000:0.0:1787114902.406813:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787114902.406819:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3307:x1873925624603392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114902.406862:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3307:x1873925624603392:12345-0@lo:400:kworker.0 Request processed in 43us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114902.406868:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787114902.406900:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624603904 00000100:00100000:0.0:1787114902.406904:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624603904 00000100:00100000:0.0:1787114902.406948:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787114902.406954:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624603904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114902.406986:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624603904:12345-0@lo:400:kworker.0 Request processed in 32us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114902.406991:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787114902.407009:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624603648:0@lo:400:kworker.0 00000100:00100000:0.0:1787114902.407033:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114902.407054:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787114902.407061:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624603776:0@lo:400:kworker.0 00000100:00100000:0.0:1787114902.407084:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114902.407142:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624603648 00000100:00100000:0.0:1787114902.407146:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624603648 00000100:00100000:0.0:1787114902.407170:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624603776 00000100:00100000:0.0:1787114902.407173:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624603776 00000100:00100000:0.0:1787114902.407193:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787114902.407199:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624603648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114902.407238:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624603648:12345-0@lo:400:kworker.0 Request processed in 39us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114902.407244:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787114902.407256:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787114902.407269:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624603776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114902.407298:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624603776:12345-0@lo:400:kworker.0 Request processed in 31us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114902.407304:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1787114902.407325:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787114902.407328:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787114902.407348:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624603776:0@lo:400:kworker.0 00000100:00100000:0.0:1787114902.407358:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624603648:0@lo:400:kworker.0 00000100:00100000:1.0:1787114902.407548:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624603392:0@lo:400:kworker.0 00010000:00080000:1.0:1787114902.407562:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af06eb71180 x1873925624603904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114902.407573:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624603904:0@lo:400:kworker.0 00010000:00010000:1.0:1787114902.853253:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787114902.920951:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624604032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787114902.921054:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114902.921174:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624604032 00000100:00100000:3.0:1787114902.921184:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624604032 00000100:00100000:3.0:1787114902.921242:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787114902.921254:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624604032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787114902.921310:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787114902.921370:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624604032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114902.921379:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787114902.921435:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af06eb71500 x1873925624604032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114902.921476:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624604032:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787114903.878127:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114904.901370:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114905.926400:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114905.982056:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114905.982314:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602550528 00000100:00100000:0.0:1787114905.982326:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602550528 00000100:00100000:0.0:1787114905.982397:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 59 00000100:00100000:0.0:1787114905.982408:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2363:x1873925602550528:12345-192.168.202.10@tcp:400:kworker.0 00000100:00080000:3.0:1787114905.982437:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787114905.982490:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2363:x1873925602550528:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 83us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114905.982498:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 59 00000100:00100000:1.0:1787114905.982733:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114905.982767:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602550400 00000100:00100000:0.0:1787114905.982771:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602550400 00000100:00100000:0.0:1787114905.982803:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 201 00000100:00100000:0.0:1787114905.982810:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2363:x1873925602550400:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787114905.982845:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2363:x1873925602550400:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 35us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114905.982853:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 201 00010000:00010000:1.0:1787114906.952304:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114907.529471:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624604160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787114907.529574:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114907.529635:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624604160 00000100:00100000:2.0:1787114907.529645:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624604160 00000100:00100000:2.0:1787114907.529713:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787114907.529724:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624604160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787114907.529775:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787114907.529827:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624604160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114907.529834:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787114907.529854:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787114907.530171:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f7d5880 x1873925624604160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114907.530190:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624604160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787114907.530938:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624604416:0@lo:400:kworker.0 00000100:00100000:2.0:1787114907.530980:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114907.531009:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787114907.531014:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624604544:0@lo:400:kworker.0 00000100:00100000:2.0:1787114907.531034:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114907.531149:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624604288:0@lo:400:kworker.0 00000100:00100000:1.0:1787114907.531184:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114907.531206:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624604800:0@lo:400:kworker.0 00000100:00100000:1.0:1787114907.531227:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114907.531244:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787114907.531249:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624604672:0@lo:400:kworker.0 00000100:00100000:1.0:1787114907.531268:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114907.531295:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624604800 00000100:00100000:1.0:1787114907.531316:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624604800 00000100:00100000:1.0:1787114907.531364:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787114907.531373:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624604800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114907.531409:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624604800:12345-0@lo:400:kworker.0 Request processed in 38us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114907.531415:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787114907.531443:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f7d6a00 x1873925624604800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114907.531455:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624604800:0@lo:400:kworker.0 00000100:00100000:1.0:1787114907.531484:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624604416 00000100:00100000:1.0:1787114907.531487:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624604416 00000100:00100000:1.0:1787114907.531508:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624604544 00000100:00100000:1.0:1787114907.531511:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624604544 00000100:00100000:1.0:1787114907.531521:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624604672 00000100:00100000:1.0:1787114907.531523:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624604672 00000100:00100000:1.0:1787114907.531533:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787114907.531538:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624604416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114907.531568:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624604416:12345-0@lo:400:kworker.0 Request processed in 29us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114907.531574:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787114907.531585:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787114907.531591:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624604544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114907.531614:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624604544:12345-0@lo:400:kworker.0 Request processed in 24us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114907.531620:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787114907.531630:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787114907.531636:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624604672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114907.531763:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624604288 00000100:00100000:3.0:1787114907.531767:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624604288 00000100:00100000:3.0:1787114907.531801:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787114907.531808:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624604288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114907.531847:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624604288:12345-0@lo:400:kworker.0 Request processed in 39us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114907.531853:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787114907.531898:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624604288:0@lo:400:kworker.0 00000100:00100000:1.0:1787114907.531966:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624604672:12345-0@lo:400:kworker.0 Request processed in 329us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114907.531972:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1787114907.532143:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787114907.532148:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787114907.532166:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624604544:0@lo:400:kworker.0 00000100:00100000:2.0:1787114907.532176:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624604416:0@lo:400:kworker.0 00000100:00100000:3.0:1787114907.532245:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624604672:0@lo:400:kworker.0 00010000:00010000:1.0:1787114907.973400:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114908.052495:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624604928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787114908.052566:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114908.052695:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624604928 00000100:00100000:1.0:1787114908.052704:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624604928 00000100:00100000:1.0:1787114908.052761:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787114908.052771:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624604928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787114908.052807:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787114908.052853:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624604928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114908.052860:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787114908.052941:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f7d2680 x1873925624604928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114908.052961:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624604928:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787114908.997387:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787114910.024145:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114911.045264:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114911.101004:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114911.101058:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114911.101087:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602550784 00000100:00100000:1.0:1787114911.101095:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602550784 00000100:00100000:1.0:1787114911.101177:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 63 00000100:00100000:1.0:1787114911.101187:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2362:x1873925602550784:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114911.101260:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2362:x1873925602550784:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 74us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114911.101268:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 63 00000100:00100000:1.0:1787114911.101290:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602550656 00000100:00100000:1.0:1787114911.101294:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602550656 00000100:00100000:1.0:1787114911.101318:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 203 00000100:00100000:1.0:1787114911.101324:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2362:x1873925602550656:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114911.101364:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2362:x1873925602550656:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 40us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114911.101371:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 203 00000100:00080000:2.0:1787114911.105283:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787114912.070743:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114912.647726:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787114912.647756:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624605056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787114912.647899:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114912.647981:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624605056 00000100:00100000:2.0:1787114912.647988:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624605056 00000100:00100000:2.0:1787114912.648054:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787114912.648064:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624605056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787114912.648101:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787114912.648169:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624605056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114912.648176:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1787114912.648196:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787114912.648227:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f7d7100 x1873925624605056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114912.648247:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624605056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787114912.648709:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624605312:0@lo:400:kworker.0 00000100:00100000:3.0:1787114912.648746:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114912.648771:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787114912.648776:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624605184:0@lo:400:kworker.0 00000100:00100000:3.0:1787114912.648813:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114912.648837:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624605696:0@lo:400:kworker.0 00000100:00100000:3.0:1787114912.648874:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114912.648901:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624605312 00000100:00100000:3.0:1787114912.648906:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624605312 00000100:00100000:3.0:1787114912.648937:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787114912.648944:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624605312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114912.648982:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624605312:12345-0@lo:400:kworker.0 Request processed in 38us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114912.648998:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787114912.649030:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624605184 00000100:00100000:3.0:1787114912.649035:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624605184 00000100:00100000:3.0:1787114912.649060:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787114912.649067:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051311050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624605184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114912.649100:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051311050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624605184:12345-0@lo:400:kworker.0 Request processed in 34us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114912.649129:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787114912.649158:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624605696 00000100:00100000:3.0:1787114912.649162:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624605696 00000100:00100000:3.0:1787114912.649196:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787114912.649202:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624605696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114912.649231:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624605696:12345-0@lo:400:kworker.0 Request processed in 29us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114912.649238:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1787114912.649261:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787114912.649279:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624605184:0@lo:400:kworker.0 00010000:00080000:3.0:1787114912.649291:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af06eb72300 x1873925624605696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114912.649300:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624605696:0@lo:400:kworker.0 00000100:00100000:3.0:1787114912.649310:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624605312:0@lo:400:kworker.0 00000100:00100000:0.0:1787114912.649592:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873925624605568:0@lo:400:kworker.0 00000100:00100000:0.0:1787114912.649626:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114912.649654:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787114912.649660:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624605440:0@lo:400:kworker.0 00000100:00100000:0.0:1787114912.649682:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114912.649711:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624605568 00000100:00100000:0.0:1787114912.649715:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624605568 00000100:00100000:0.0:1787114912.649744:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624605440 00000100:00100000:0.0:1787114912.649748:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624605440 00000100:00100000:0.0:1787114912.649768:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787114912.649774:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873925624605568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114912.649828:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873925624605568:12345-0@lo:400:kworker.0 Request processed in 53us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114912.649835:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787114912.649981:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787114912.649988:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624605440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114912.650032:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624605440:12345-0@lo:400:kworker.0 Request processed in 44us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114912.650038:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787114912.650071:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624605440:0@lo:400:kworker.0 00000100:00100000:0.0:1787114912.650081:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873925624605568:0@lo:400:kworker.0 00000100:00080000:2.0:1787114912.650281:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787114913.097430:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787114913.157351:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624605824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787114913.157470:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114913.161100:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624605824 00000100:00100000:0.0:1787114913.161147:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624605824 00000100:00100000:0.0:1787114913.161208:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787114913.161217:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624605824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787114913.161254:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787114913.161345:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624605824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (3875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114913.161353:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1787114913.166680:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07b68c000 x1873925624605824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114913.166722:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624605824:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787114914.118367:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114915.141393:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114916.165513:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787114916.218355:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114916.218424:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114916.220889:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602551040 00000100:00100000:0.0:1787114916.220906:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602551040 00000100:00100000:0.0:1787114916.220995:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 67 00000100:00100000:0.0:1787114916.221007:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602551040:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787114916.221093:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602551040:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 89us (2667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114916.221101:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 67 00000100:00080000:0.0:1787114916.221141:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787114916.221455:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602550912 00000100:00100000:1.0:1787114916.221461:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602550912 00000100:00100000:1.0:1787114916.221533:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 205 00000100:00100000:1.0:1787114916.221543:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051312c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2364:x1873925602550912:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114916.221584:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051312c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2364:x1873925602550912:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 43us (3236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114916.221591:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 205 00000001:02000400:2.0:1787114916.450458:0:9957:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 00:48:35 (1787114915) === 00000100:00100000:3.0:1787114916.788629:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114916.788782:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602551168 00000100:00100000:1.0:1787114916.788794:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602551168 00000100:00100000:1.0:1787114916.788878:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 206 00000100:00100000:1.0:1787114916.788890:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051311850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:8111:x1873925602551168:12345-192.168.202.10@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787114916.788910:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787114916.788933:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af041682a00/0x194cd781e88c83ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1391 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114916.788979:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af041682a00/0x194cd781e88c83ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1391 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114916.788992:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af041682a00/0x194cd781e88c83ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1391 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114916.789034:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041682a00, rc 0) 00000100:00100000:1.0:1787114916.789144:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051311850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+11:8111:x1873925602551168:12345-192.168.202.10@tcp:101:mount.lustre.0 Request processed in 256us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114916.789152:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 206 00000100:00100000:0.0:1787114916.794768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114916.794913:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602551296 00000100:00100000:1.0:1787114916.794926:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602551296 00000100:00100000:1.0:1787114916.795007:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 207 00000100:00100000:1.0:1787114916.795027:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051313850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+11:8111:x1873925602551296:12345-192.168.202.10@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787114916.795461:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051313850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+11:8111:x1873925602551296:12345-192.168.202.10@tcp:501:mount.lustre.0 Request processed in 442us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114916.795470:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 207 00000100:00100000:0.0:1787114916.801318:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114916.801466:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602551424 00000100:00100000:3.0:1787114916.801480:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602551424 00000100:00100000:3.0:1787114916.802220:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 208 00000100:00100000:3.0:1787114916.802933:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051310850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+11:8111:x1873925602551424:12345-192.168.202.10@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787114916.811692:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051310850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+11:8111:x1873925602551424:12345-192.168.202.10@tcp:503:mount.lustre.0 Request processed in 9442us (10437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114916.811711:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 208 00000100:00100000:3.0:1787114916.814618:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114916.815189:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602551552 00000100:00100000:1.0:1787114916.815202:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602551552 00000100:00100000:1.0:1787114916.815277:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 209 00000100:00100000:1.0:1787114916.815288:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051310450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+11:8115:x1873925602551552:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787114916.817437:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051310450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+11:8115:x1873925602551552:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 2136us (2817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114916.817453:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 209 00000100:00100000:3.0:1787114916.842237:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114916.842473:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602551680 00000100:00100000:1.0:1787114916.842486:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602551680 00000100:00100000:1.0:1787114916.843292:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 210 00000100:00100000:1.0:1787114916.843309:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051313450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+11:8115:x1873925602551680:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787114916.844189:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051313450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+11:8115:x1873925602551680:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 879us (1960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114916.844216:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 210 00000100:00100000:0.0:1787114916.852516:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114916.852739:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602551808 00000100:00100000:1.0:1787114916.852902:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602551808 00000100:00100000:1.0:1787114916.853419:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 211 00000100:00100000:1.0:1787114916.853433:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051311450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+11:8111:x1873925602551808:12345-192.168.202.10@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787114916.853456:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787114916.853480:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af041682600/0x194cd781e88c83c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d13bb expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114916.853517:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af041682600/0x194cd781e88c83c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13bb expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114916.853529:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af041682600/0x194cd781e88c83c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13bb expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114916.853539:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041682600, rc 0) 00000100:00100000:1.0:1787114916.853608:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051311450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:8111:x1873925602551808:12345-192.168.202.10@tcp:101:mount.lustre.0 Request processed in 180us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114916.853617:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 211 00000100:00100000:2.0:1787114916.862570:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114916.864316:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602551936 00000100:00100000:1.0:1787114916.864335:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602551936 00000100:00100000:1.0:1787114916.864419:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 212 00000100:00100000:1.0:1787114916.864430:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051312450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:8111:x1873925602551936:12345-192.168.202.10@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787114916.864466:0:5780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787114916.864501:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787114916.864506:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787114916.864510:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787114916.864519:0:5780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787114916.869466:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051312450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:8111:x1873925602551936:12345-192.168.202.10@tcp:256:mount.lustre.0 Request processed in 5019us (7206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114916.869484:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 212 00000100:00100000:0.0:1787114916.894340:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114916.894597:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602552064 00000100:00100000:1.0:1787114916.894611:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602552064 00000100:00100000:3.0:1787114916.895769:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 213 00000100:00100000:3.0:1787114916.895791:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051312050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:8111:x1873925602552064:12345-192.168.202.10@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787114916.895824:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787114916.896228:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af0429cba00/0x194cd781e88c83c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d13c2 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114916.896384:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af0429cba00/0x194cd781e88c83c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13c2 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114916.896397:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af0429cba00/0x194cd781e88c83c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13c2 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114916.896433:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429cba00, rc 0) 00000100:00100000:3.0:1787114916.896517:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051312050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:8111:x1873925602552064:12345-192.168.202.10@tcp:101:mount.lustre.0 Request processed in 735us (2191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114916.896526:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 213 00000100:00100000:2.0:1787114916.904086:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114916.909411:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602552192 00000100:00100000:1.0:1787114916.909436:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602552192 00000100:00100000:0.0:1787114916.910531:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 214 00000100:00100000:0.0:1787114916.910549:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051310050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:8111:x1873925602552192:12345-192.168.202.10@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787114916.911087:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051310050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:8111:x1873925602552192:12345-192.168.202.10@tcp:501:mount.lustre.0 Request processed in 540us (7015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114916.911097:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 214 00000100:00100000:0.0:1787114916.923788:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114916.923999:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602552320 00000100:00100000:3.0:1787114916.924011:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602552320 00000100:00100000:3.0:1787114916.924080:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 215 00000100:00100000:3.0:1787114916.924092:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051311c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:8111:x1873925602552320:12345-192.168.202.10@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787114916.924435:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051311c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:8111:x1873925602552320:12345-192.168.202.10@tcp:503:mount.lustre.0 Request processed in 345us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114916.924444:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 215 00000100:00100000:1.0:1787114916.929643:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114916.931406:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602552448 00000100:00100000:0.0:1787114916.931446:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602552448 00000100:00100000:0.0:1787114916.931526:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 216 00000100:00100000:0.0:1787114916.931539:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051313050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:8119:x1873925602552448:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787114916.938071:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051313050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:8119:x1873925602552448:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 5266us (7185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114916.938102:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 216 00000100:00100000:0.0:1787114916.952347:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114916.952442:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602552576 00000100:00100000:2.0:1787114916.952455:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602552576 00000100:00100000:2.0:1787114916.952526:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 217 00000100:00100000:2.0:1787114916.952538:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051313c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:8119:x1873925602552576:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787114916.952902:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051313c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:8119:x1873925602552576:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 365us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114916.952913:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 217 00000100:00100000:0.0:1787114916.957361:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114916.957406:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114916.957449:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602552704 00000100:00100000:0.0:1787114916.957462:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602552704 00000100:00100000:0.0:1787114916.957515:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602553088 00000100:00100000:0.0:1787114916.957518:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602553088 00000100:00100000:0.0:1787114916.957566:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 68 00000100:00100000:0.0:1787114916.957577:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2362:x1873925602553088:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787114916.957690:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2362:x1873925602553088:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 115us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114916.957699:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 68 00000100:00100000:0.0:1787114916.957720:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 10 00000100:00100000:0.0:1787114916.957725:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2360:x1873925602552704:12345-192.168.202.10@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787114916.957755:0:5787:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 067b55fc-03d7-46d6-801a-48936d919d16@192.168.202.10@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:0.0:1787114916.957822:0:5787:0:(genops.c:1406:class_connect()) connect: client 067b55fc-03d7-46d6-801a-48936d919d16, cookie 0x194cd781e88c83cf 00000004:00100000:0.0:1787114916.957869:0:5787:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787114916.958276:0:5787:0:(import.c:65:import_set_state_nolock()) ffff8af045130000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787114916.958320:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067b55fc-03d7-46d6-801a-48936d919d16+6:2360:x1873925602552704:12345-192.168.202.10@tcp:38:mount.lustre.0 Request processed in 592us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114916.958350:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 10 00000100:00100000:0.0:1787114916.973073:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114916.973174:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114916.973226:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602552960 00000100:00100000:3.0:1787114916.973241:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602552960 00000100:00100000:3.0:1787114916.973319:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602552832 00000100:00100000:3.0:1787114916.973323:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602552832 00000100:00100000:3.0:1787114916.973350:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00100000:3.0:1787114916.973359:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+7:8111:x1873925602552960:12345-192.168.202.10@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787114916.973403:0:7216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1787114916.973421:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787114916.973454:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12 00000100:00100000:0.0:1787114916.973471:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067b55fc-03d7-46d6-801a-48936d919d16+7:0:x1873925602552832:12345-192.168.202.10@tcp:41:mount.lustre.0 00000100:00100000:3.0:1787114916.973502:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+7:8111:x1873925602552960:12345-192.168.202.10@tcp:41:mount.lustre.0 Request processed in 142us (442us total) trans 0 rc 0/0 00000004:00000024:0.0:1787114916.973506:0:5785:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787114916.973514:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00100000:0.0:1787114916.973573:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067b55fc-03d7-46d6-801a-48936d919d16+6:0:x1873925602552832:12345-192.168.202.10@tcp:41:mount.lustre.0 Request processed in 106us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114916.973582:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12 00000100:00100000:0.0:1787114916.990243:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114916.990342:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602553216 00000100:00100000:3.0:1787114916.990351:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602553216 00000100:00100000:3.0:1787114916.990411:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:3.0:1787114916.990422:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+6:8111:x1873925602553216:12345-192.168.202.10@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787114916.990538:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+6:8111:x1873925602553216:12345-192.168.202.10@tcp:40:mount.lustre.0 Request processed in 117us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114916.990545:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:0.0:1787114917.009591:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114917.009637:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114917.009760:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602553344 00000100:00100000:1.0:1787114917.009771:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602553344 00000100:00100000:1.0:1787114917.009831:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602553472 00000100:00100000:1.0:1787114917.009834:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602553472 00000100:00100000:1.0:1787114917.009856:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12 00000100:00100000:1.0:1787114917.009864:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1873925602553344:12345-192.168.202.10@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787114917.009898:0:6577:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 067b55fc-03d7-46d6-801a-48936d919d16@192.168.202.10@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:1.0:1787114917.009940:0:6577:0:(genops.c:1406:class_connect()) connect: client 067b55fc-03d7-46d6-801a-48936d919d16, cookie 0x194cd781e88c83d6 00002000:00100000:1.0:1787114917.009952:0:6577:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 067b55fc-03d7-46d6-801a-48936d919d16/ffff8af06f290800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113803 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787114917.009992:0:6577:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787114917.010270:0:6577:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787114917.010654:0:6577:0:(import.c:65:import_set_state_nolock()) ffff8af06f295000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787114917.010730:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067b55fc-03d7-46d6-801a-48936d919d16+6:2360:x1873925602553344:12345-192.168.202.10@tcp:8:mount.lustre.0 Request processed in 864us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114917.010738:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12 00000100:00100000:0.0:1787114917.010760:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:0.0:1787114917.010765:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1873925602553472:12345-192.168.202.10@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787114917.010784:0:6577:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 067b55fc-03d7-46d6-801a-48936d919d16@192.168.202.10@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:0.0:1787114917.010814:0:6577:0:(genops.c:1406:class_connect()) connect: client 067b55fc-03d7-46d6-801a-48936d919d16, cookie 0x194cd781e88c83dd 00002000:00100000:0.0:1787114917.010821:0:6577:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 067b55fc-03d7-46d6-801a-48936d919d16/ffff8af045136800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113803 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787114917.010836:0:6577:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787114917.011001:0:6577:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787114917.011029:0:6577:0:(import.c:65:import_set_state_nolock()) ffff8af045134000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787114917.011054:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067b55fc-03d7-46d6-801a-48936d919d16+6:2360:x1873925602553472:12345-192.168.202.10@tcp:8:mount.lustre.0 Request processed in 287us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114917.011061:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:1.0:1787114917.013606:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114917.013732:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602553600 00000100:00100000:0.0:1787114917.013741:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602553600 00000100:00100000:0.0:1787114917.013795:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1 00000100:00100000:0.0:1787114917.013815:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067b55fc-03d7-46d6-801a-48936d919d16+6:8111:x1873925602553600:12345-192.168.202.10@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787114917.014285:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787114917.014548:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067b55fc-03d7-46d6-801a-48936d919d16+6:8111:x1873925602553600:12345-192.168.202.10@tcp:33:mount.lustre.0 Request processed in 734us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114917.014556:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1 00010000:00010000:1.0:1787114917.189348:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114917.765290:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787114917.765311:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624605952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787114917.765389:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114917.765603:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624606208:0@lo:400:kworker.0 00000100:00100000:1.0:1787114917.765648:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114917.765696:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624606720:0@lo:400:kworker.0 00000100:00100000:2.0:1787114917.765698:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624606080:0@lo:400:kworker.0 00000100:00100000:1.0:1787114917.765720:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114917.765722:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114917.765741:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873925624606592:0@lo:400:kworker.0 00000100:00100000:1.0:1787114917.765742:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787114917.765753:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624606336:0@lo:400:kworker.0 00000100:00100000:2.0:1787114917.765762:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114917.765778:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787114917.765783:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624606464:0@lo:400:kworker.0 00000100:00100000:2.0:1787114917.765814:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114917.765841:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624606208 00000100:00100000:2.0:1787114917.765847:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624606208 00000100:00100000:2.0:1787114917.765885:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624606592 00000100:00100000:2.0:1787114917.765888:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624606592 00000100:00100000:3.0:1787114917.765914:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624606720 00000100:00100000:2.0:1787114917.765916:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787114917.765917:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624606720 00000100:00100000:2.0:1787114917.765924:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624606208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114917.765941:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624606464 00000100:00100000:3.0:1787114917.765943:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624606464 00000100:00100000:3.0:1787114917.765958:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787114917.765964:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624606720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114917.765998:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624606720:12345-0@lo:400:kworker.0 Request processed in 34us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114917.766005:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787114917.766021:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787114917.766027:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624606464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114917.766036:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624606208:12345-0@lo:400:kworker.0 Request processed in 114us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114917.766043:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787114917.766054:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624606464:12345-0@lo:400:kworker.0 Request processed in 28us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114917.766056:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787114917.766060:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787114917.766061:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873925624606592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114917.766087:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873925624606592:12345-0@lo:400:kworker.0 Request processed in 26us (324us total) trans 0 rc 0/0 00010000:00080000:3.0:1787114917.766092:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f7d2300 x1873925624606464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114917.766092:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787114917.766122:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624606464:0@lo:400:kworker.0 00000100:00100000:3.0:1787114917.766135:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873925624606592:0@lo:400:kworker.0 00000100:00100000:2.0:1787114917.766154:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624606080 00000100:00100000:2.0:1787114917.766158:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624606080 00000100:00080000:3.0:1787114917.766163:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787114917.766167:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787114917.766169:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787114917.766191:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787114917.766197:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051312850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3307:x1873925624606080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114917.766247:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051312850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3307:x1873925624606080:12345-0@lo:400:kworker.0 Request processed in 50us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114917.766253:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787114917.766302:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624606080:0@lo:400:kworker.0 00000100:00100000:1.0:1787114917.766369:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114917.766403:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624606208:0@lo:400:kworker.0 00010000:00080000:1.0:1787114917.766413:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f7d3480 x1873925624606720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114917.766421:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624606720:0@lo:400:kworker.0 00000100:00100000:2.0:1787114917.767127:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624606336 00000100:00100000:2.0:1787114917.767133:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624606336 00000100:00080000:3.0:1787114917.767290:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787114917.767614:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787114917.767623:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624606336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114917.767678:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624606336:12345-0@lo:400:kworker.0 Request processed in 56us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114917.767684:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787114917.768086:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624606336:0@lo:400:kworker.0 00000100:00100000:0.0:1787114917.771286:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624605952 00000100:00100000:0.0:1787114917.771300:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624605952 00000100:00100000:0.0:1787114917.771455:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787114917.771468:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624605952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787114917.771503:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787114917.771623:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624605952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (6233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114917.771630:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787114917.771726:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f7d7100 x1873925624605952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114917.771750:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624605952:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787114918.213218:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114918.286875:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787114918.286911:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624606848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787114918.287353:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114918.287738:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624606848 00000100:00100000:0.0:1787114918.287748:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624606848 00000100:00100000:0.0:1787114918.287860:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787114918.287906:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624606848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787114918.287985:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787114918.288103:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624606848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 234us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114918.288251:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787114918.288361:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f7d1f80 x1873925624606848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114918.288425:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624606848:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787114919.237643:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114920.277664:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787114920.361860:0:5807:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 067b55fc-03d7-46d6-801a-48936d919d16 00000001:00100000:1.0:1787114920.435738:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 067b55fc-03d7-46d6-801a-48936d919d16 00010000:00010000:1.0:1787114921.287850:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787114921.954718:0:6604:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 067b55fc-03d7-46d6-801a-48936d919d16 00010000:00010000:3.0:1787114922.309607:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114922.376203:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114922.376256:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114922.376299:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114922.376331:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114922.376356:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114922.377847:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602554112 00000100:00100000:0.0:1787114922.377862:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602554112 00000100:00100000:0.0:1787114922.377939:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602554240 00000100:00100000:0.0:1787114922.377943:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602554240 00000100:00100000:0.0:1787114922.377962:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 33 00000100:00100000:0.0:1787114922.377971:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602554112:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787114922.378045:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602554112:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 74us (1787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114922.378053:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 33 00000100:00100000:0.0:1787114922.378070:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 34 00000100:00100000:0.0:1787114922.378077:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602554240:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787114922.378101:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602554240:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 25us (1744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114922.378135:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 34 00000100:00100000:1.0:1787114922.378461:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602553728 00000100:00100000:1.0:1787114922.378467:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602553728 00000100:00100000:1.0:1787114922.378504:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 219 00000100:00100000:1.0:1787114922.378512:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051310c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602553728:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114922.378546:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051310c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602553728:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 36us (2247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114922.378553:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 219 00000100:00080000:2.0:1787114922.380535:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787114922.380544:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787114922.380845:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602553856 00000100:00100000:3.0:1787114922.380855:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602553856 00000100:00100000:3.0:1787114922.380976:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602553984 00000100:00100000:3.0:1787114922.380980:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602553984 00000100:00100000:3.0:1787114922.381017:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 72 00000100:00100000:3.0:1787114922.381027:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2362:x1873925602553856:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787114922.381093:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2362:x1873925602553856:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 68us (4900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114922.381101:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 72 00000100:00100000:3.0:1787114922.381147:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 73 00000100:00100000:3.0:1787114922.381155:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602553984:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787114922.381179:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602553984:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 24us (4846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114922.381185:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 73 00000100:00080000:2.0:1787114922.384269:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787114922.886140:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787114922.886175:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624606976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787114922.886247:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114922.886340:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624606976 00000100:00100000:2.0:1787114922.886348:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624606976 00000100:00100000:2.0:1787114922.886409:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787114922.886428:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624606976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787114922.886464:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787114922.886522:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624606976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114922.886529:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1787114922.886552:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787114922.887031:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f7d5880 x1873925624606976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114922.887070:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624606976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787114922.887379:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624607232:0@lo:400:kworker.0 00000100:00100000:3.0:1787114922.887417:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114922.887439:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787114922.887445:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624607360:0@lo:400:kworker.0 00000100:00100000:3.0:1787114922.887467:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114922.887495:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624607232 00000100:00100000:3.0:1787114922.887500:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624607232 00000100:00100000:3.0:1787114922.887539:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624607360 00000100:00100000:3.0:1787114922.887543:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624607360 00000100:00100000:3.0:1787114922.887567:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787114922.887574:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624607232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114922.887616:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624607232:12345-0@lo:400:kworker.0 Request processed in 42us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114922.887623:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787114922.887637:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787114922.887643:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07398a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624607360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114922.887669:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07398a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624607360:12345-0@lo:400:kworker.0 Request processed in 27us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114922.887676:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787114922.887693:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787114922.887713:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624607360:0@lo:400:kworker.0 00000100:00100000:3.0:1787114922.887722:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624607232:0@lo:400:kworker.0 00000100:00100000:0.0:1787114922.887927:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624607488:0@lo:400:kworker.0 00000100:00100000:0.0:1787114922.887957:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114922.887988:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787114922.887994:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624607104:0@lo:400:kworker.0 00000100:00100000:0.0:1787114922.888021:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114922.888044:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624607616:0@lo:400:kworker.0 00000100:00100000:0.0:1787114922.888388:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114922.888433:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624607104 00000100:00100000:0.0:1787114922.888437:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624607104 00000100:00100000:0.0:1787114922.888466:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787114922.888474:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624607104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114922.888510:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624607104:12345-0@lo:400:kworker.0 Request processed in 36us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114922.888517:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787114922.888542:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624607488 00000100:00100000:0.0:1787114922.888546:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624607488 00000100:00100000:0.0:1787114922.888574:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787114922.888581:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624607488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114922.888611:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624607488:12345-0@lo:400:kworker.0 Request processed in 30us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114922.888617:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787114922.888648:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624607104:0@lo:400:kworker.0 00000100:00100000:0.0:1787114922.888659:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624607488:0@lo:400:kworker.0 00000100:00100000:0.0:1787114922.888680:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624607616 00000100:00100000:0.0:1787114922.888683:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624607616 00000100:00100000:0.0:1787114922.888714:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787114922.888721:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624607616:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787114922.889040:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787114922.889044:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787114922.890619:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624607616:12345-0@lo:400:kworker.0 Request processed in 1892us (2224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114922.890632:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1787114922.891064:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af051362a00 x1873925624607616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114922.891079:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624607616:0@lo:400:kworker.0 00010000:00010000:1.0:1787114923.337089:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114923.397702:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624607744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787114923.397848:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114923.398142:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624607744 00000100:00100000:3.0:1787114923.398154:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624607744 00000100:00100000:3.0:1787114923.398217:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787114923.398229:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624607744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787114923.398352:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787114923.398418:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624607744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 190us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114923.398427:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787114923.398477:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af073989180 x1873925624607744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114923.398510:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624607744:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787114924.207532:0:10152:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg210-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1787114924.358558:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114925.382364:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787114926.405254:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114927.436390:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114927.487748:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114927.487789:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114927.487836:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114927.487875:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114927.487897:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114927.487998:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602554624 00000100:00100000:1.0:1787114927.488009:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602554624 00000100:00100000:1.0:1787114927.488073:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602554496 00000100:00100000:1.0:1787114927.488076:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602554496 00000100:00100000:1.0:1787114927.488100:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 77 00000100:00100000:1.0:1787114927.488132:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602554624:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114927.488209:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602554624:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 99us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114927.488217:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 77 00000100:00100000:1.0:1787114927.488234:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 78 00000100:00100000:1.0:1787114927.488241:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2362:x1873925602554496:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114927.488264:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2362:x1873925602554496:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 24us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114927.488271:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 78 00000100:00100000:0.0:1787114927.488596:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602554368 00000100:00100000:0.0:1787114927.488602:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602554368 00000100:00100000:0.0:1787114927.488640:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 221 00000100:00100000:0.0:1787114927.488647:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602554368:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787114927.488680:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602554368:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 34us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114927.488686:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 221 00000100:00100000:3.0:1787114927.489271:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602554880 00000100:00100000:3.0:1787114927.489277:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602554880 00000100:00100000:3.0:1787114927.489315:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602554752 00000100:00100000:3.0:1787114927.489319:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602554752 00000100:00100000:3.0:1787114927.489337:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 36 00000100:00100000:3.0:1787114927.489344:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602554880:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787114927.489376:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602554880:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 33us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114927.489383:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 36 00000100:00100000:3.0:1787114927.489397:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 37 00000100:00100000:3.0:1787114927.489402:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602554752:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787114927.489423:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602554752:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 21us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114927.489429:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 37 00000100:00080000:2.0:1787114927.489903:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787114927.489908:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787114927.489910:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787114928.005344:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624607872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787114928.005450:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114928.005656:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624608000:0@lo:400:kworker.0 00000100:00100000:3.0:1787114928.005708:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114928.005743:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787114928.005750:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624608128:0@lo:400:kworker.0 00000100:00100000:3.0:1787114928.005775:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114928.005802:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624608000 00000100:00100000:3.0:1787114928.005809:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624608000 00000100:00100000:3.0:1787114928.005938:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787114928.005947:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624608000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114928.005999:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624608000:12345-0@lo:400:kworker.0 Request processed in 53us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114928.006006:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787114928.006053:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624608000:0@lo:400:kworker.0 00000100:00100000:0.0:1787114928.007618:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624607872 00000100:00100000:0.0:1787114928.007628:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624607872 00000100:00100000:0.0:1787114928.007679:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787114928.007688:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624607872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787114928.007745:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787114928.008501:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787114928.008520:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624608512:0@lo:400:kworker.0 00000100:00100000:2.0:1787114928.008565:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114928.008627:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624608512 00000100:00100000:2.0:1787114928.008634:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624608512 00000100:00100000:2.0:1787114928.008677:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787114928.008686:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624608512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114928.008738:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624608512:12345-0@lo:400:kworker.0 Request processed in 54us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114928.008745:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1787114928.008762:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787114928.008790:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f6c3100 x1873925624608512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114928.008811:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624608512:0@lo:400:kworker.0 00000100:00100000:2.0:1787114928.008834:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624608256:0@lo:400:kworker.0 00000100:00100000:2.0:1787114928.008865:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114928.008887:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787114928.008892:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624608384:0@lo:400:kworker.0 00000100:00100000:2.0:1787114928.009315:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114928.009371:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624607872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1683us (3920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114928.009379:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787114928.009603:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624608128 00000100:00100000:0.0:1787114928.009609:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624608128 00000100:00100000:0.0:1787114928.009636:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624608256 00000100:00100000:0.0:1787114928.009639:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624608256 00000100:00100000:0.0:1787114928.009654:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624608384 00000100:00100000:0.0:1787114928.009656:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624608384 00000100:00100000:0.0:1787114928.009670:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787114928.009676:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624608128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114928.009732:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624608128:12345-0@lo:400:kworker.0 Request processed in 56us (3956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114928.009745:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787114928.009757:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787114928.009809:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624608256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114928.009841:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624608256:12345-0@lo:400:kworker.0 Request processed in 78us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114928.009847:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787114928.009859:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787114928.009865:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624608384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114928.009892:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624608384:12345-0@lo:400:kworker.0 Request processed in 27us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114928.009897:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:1.0:1787114928.010809:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f6c3b80 x1873925624607872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114928.010832:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624607872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787114928.012381:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624608384:0@lo:400:kworker.0 00000100:00100000:2.0:1787114928.012396:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624608256:0@lo:400:kworker.0 00000100:00080000:2.0:1787114928.012423:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787114928.012445:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624608128:0@lo:400:kworker.0 00010000:00010000:2.0:1787114928.458066:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114928.524264:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624608640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787114928.524326:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114928.524420:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624608640 00000100:00100000:3.0:1787114928.524427:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624608640 00000100:00100000:3.0:1787114928.524475:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787114928.524484:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624608640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787114928.524514:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787114928.524555:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624608640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114928.524562:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1787114928.524596:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af073988380 x1873925624608640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114928.524612:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624608640:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787114929.480768:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787114930.514567:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114931.525484:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114932.553354:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114932.604885:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114932.604919:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114932.604946:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114932.604968:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114932.604992:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114932.605019:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602555264 00000100:00100000:2.0:1787114932.605029:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602555264 00000100:00100000:2.0:1787114932.605087:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602555136 00000100:00100000:2.0:1787114932.605091:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602555136 00000100:00100000:2.0:1787114932.605139:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 82 00000100:00100000:2.0:1787114932.605149:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+5:2361:x1873925602555264:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787114932.605239:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+5:2361:x1873925602555264:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 91us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114932.605247:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 82 00000100:00100000:2.0:1787114932.605263:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 83 00000100:00100000:2.0:1787114932.605271:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2361:x1873925602555136:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787114932.605296:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2361:x1873925602555136:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 27us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114932.605302:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 83 00000100:00100000:2.0:1787114932.605320:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602555520 00000100:00100000:2.0:1787114932.605325:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602555520 00000100:00100000:2.0:1787114932.605349:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602555392 00000100:00100000:2.0:1787114932.605352:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602555392 00000100:00100000:2.0:1787114932.605367:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 39 00000100:00100000:2.0:1787114932.605372:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067b55fc-03d7-46d6-801a-48936d919d16+5:2361:x1873925602555520:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787114932.605397:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067b55fc-03d7-46d6-801a-48936d919d16+5:2361:x1873925602555520:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 26us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114932.605403:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 39 00000100:00100000:2.0:1787114932.605413:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 40 00000100:00100000:2.0:1787114932.605418:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067b55fc-03d7-46d6-801a-48936d919d16+5:2361:x1873925602555392:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787114932.605440:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067b55fc-03d7-46d6-801a-48936d919d16+5:2361:x1873925602555392:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 21us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114932.605446:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 40 00000100:00080000:2.0:1787114932.605468:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787114932.605472:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787114932.605547:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787114932.606623:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602555008 00000100:00100000:0.0:1787114932.606633:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602555008 00000100:00100000:0.0:1787114932.606692:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 223 00000100:00100000:0.0:1787114932.606700:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2361:x1873925602555008:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787114932.606757:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2361:x1873925602555008:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 57us (1881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114932.606763:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 223 00000100:00100000:1.0:1787114933.126583:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787114933.126610:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624608768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787114933.126728:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114933.126983:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624609152:0@lo:400:kworker.0 00000100:00100000:3.0:1787114933.127034:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114933.127078:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787114933.127085:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624609024:0@lo:400:kworker.0 00000100:00100000:3.0:1787114933.127126:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114933.127157:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624609152 00000100:00100000:3.0:1787114933.127164:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624609152 00000100:00100000:3.0:1787114933.127224:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624609024 00000100:00100000:3.0:1787114933.127228:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624609024 00000100:00100000:3.0:1787114933.127251:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787114933.127271:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624609152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114933.127324:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624609152:12345-0@lo:400:kworker.0 Request processed in 64us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114933.127331:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787114933.127348:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787114933.127355:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624609024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114933.127433:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624609024:12345-0@lo:400:kworker.0 Request processed in 27us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114933.127439:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1787114933.127459:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787114933.127497:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624609024:0@lo:400:kworker.0 00000100:00100000:3.0:1787114933.127508:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624609152:0@lo:400:kworker.0 00000100:00100000:2.0:1787114933.127960:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624608768 00000100:00100000:2.0:1787114933.127966:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624608768 00000100:00100000:2.0:1787114933.128009:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787114933.128016:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624608768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787114933.128054:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787114933.128129:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624608768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114933.128136:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787114933.128302:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624608896:0@lo:400:kworker.0 00000100:00100000:1.0:1787114933.128334:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114933.128366:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624609408:0@lo:400:kworker.0 00000100:00100000:1.0:1787114933.128387:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787114933.128414:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f6c1500 x1873925624608768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114933.128432:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624608768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787114933.128446:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787114933.128451:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624609280:0@lo:400:kworker.0 00000100:00100000:1.0:1787114933.128474:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114933.128500:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624609408 00000100:00100000:1.0:1787114933.128504:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624609408 00000100:00100000:1.0:1787114933.128534:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787114933.128540:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624609408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114933.128574:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624609408:12345-0@lo:400:kworker.0 Request processed in 35us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114933.128580:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787114933.128599:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624609280 00000100:00100000:1.0:1787114933.128602:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624609280 00000100:00100000:1.0:1787114933.128625:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787114933.128631:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624609280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114933.128673:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624609280:12345-0@lo:400:kworker.0 Request processed in 42us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114933.128690:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787114933.128729:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624609280:0@lo:400:kworker.0 00010000:00080000:1.0:1787114933.128740:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af06eb71500 x1873925624609408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114933.128748:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624609408:0@lo:400:kworker.0 00000100:00100000:2.0:1787114933.128986:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624608896 00000100:00100000:2.0:1787114933.128991:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624608896 00000100:00100000:2.0:1787114933.129025:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787114933.129031:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624608896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114933.129086:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624608896:12345-0@lo:400:kworker.0 Request processed in 54us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114933.129092:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:3.0:1787114933.129493:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787114933.129498:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787114933.129500:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787114933.133289:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624608896:0@lo:400:kworker.0 00010000:00010000:0.0:1787114933.574244:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114933.638326:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787114933.638358:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624609536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787114933.638427:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114933.638613:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624609536 00000100:00100000:3.0:1787114933.638621:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624609536 00000100:00100000:3.0:1787114933.638679:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787114933.638688:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624609536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787114933.638722:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787114933.638762:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624609536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114933.638769:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1787114933.638966:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f962a00 x1873925624609536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114933.638985:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624609536:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787114934.597236:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114935.623317:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114936.645531:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114937.677894:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787114937.721637:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114937.723098:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114937.723212:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114937.723244:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602555776 00000100:00100000:3.0:1787114937.723256:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602555776 00000100:00100000:3.0:1787114937.723353:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602555904 00000100:00100000:3.0:1787114937.723356:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602555904 00000100:00100000:3.0:1787114937.723377:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 87 00000100:00100000:3.0:1787114937.723396:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2363:x1873925602555776:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787114937.723470:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2363:x1873925602555776:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 77us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114937.723477:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 87 00000100:00100000:3.0:1787114937.723494:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 88 00000100:00100000:3.0:1787114937.723500:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067b55fc-03d7-46d6-801a-48936d919d16+5:2363:x1873925602555904:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787114937.723522:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067b55fc-03d7-46d6-801a-48936d919d16+5:2363:x1873925602555904:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 22us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114937.723528:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 88 00000100:00080000:3.0:1787114937.723543:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787114937.724363:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602555648 00000100:00100000:1.0:1787114937.724371:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602555648 00000100:00100000:1.0:1787114937.724423:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 225 00000100:00100000:1.0:1787114937.724435:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2363:x1873925602555648:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114937.724482:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2363:x1873925602555648:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 52us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114937.724488:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 225 00000100:00100000:3.0:1787114937.725958:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114937.726047:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114937.747411:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602556032 00000100:00100000:0.0:1787114937.747425:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602556032 00000100:00100000:0.0:1787114937.747522:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602556160 00000100:00100000:0.0:1787114937.747526:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602556160 00000100:00100000:0.0:1787114937.747561:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 14 00000100:00100000:0.0:1787114937.747572:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067b55fc-03d7-46d6-801a-48936d919d16+5:2360:x1873925602556032:12345-192.168.202.10@tcp:9:kworker.0 00000020:00000080:0.0:1787114937.747605:0:6577:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c83d6 00000100:00080000:0.0:1787114937.747626:0:6577:0:(import.c:65:import_set_state_nolock()) ffff8af06f295000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787114937.747667:0:6577:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787114937.748053:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067b55fc-03d7-46d6-801a-48936d919d16+2:2360:x1873925602556032:12345-192.168.202.10@tcp:9:kworker.0 Request processed in 469us (22086us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114937.748061:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 14 00000100:00100000:0.0:1787114937.748273:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15 00000100:00100000:0.0:1787114937.748283:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067b55fc-03d7-46d6-801a-48936d919d16+5:2360:x1873925602556160:12345-192.168.202.10@tcp:9:kworker.0 00000020:00000080:0.0:1787114937.748298:0:6577:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c83dd 00000100:00080000:0.0:1787114937.748317:0:6577:0:(import.c:65:import_set_state_nolock()) ffff8af045134000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787114937.748342:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787114937.748389:0:6577:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787114937.748584:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067b55fc-03d7-46d6-801a-48936d919d16+2:2360:x1873925602556160:12345-192.168.202.10@tcp:9:kworker.0 Request processed in 302us (22547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114937.748591:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15 00010000:00010000:3.0:1787114937.748998:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787114937.749019:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787114937.749024:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787114938.248160:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624609664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787114938.248228:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114938.248298:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624609664 00000100:00100000:1.0:1787114938.248304:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624609664 00000100:00100000:1.0:1787114938.248356:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787114938.248364:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624609664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787114938.248400:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787114938.248443:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624609664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114938.248450:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1787114938.248468:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787114938.248493:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f7d0380 x1873925624609664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114938.248517:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624609664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787114938.257368:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b68ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624609920:0@lo:400:kworker.0 00000100:00100000:0.0:1787114938.257440:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114938.257494:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787114938.257831:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624609792:0@lo:400:kworker.0 00000100:00100000:0.0:1787114938.257864:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114938.257888:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624610304:0@lo:400:kworker.0 00000100:00100000:0.0:1787114938.257911:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114938.257937:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b68dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624610048:0@lo:400:kworker.0 00000100:00100000:0.0:1787114938.257976:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114938.257995:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787114938.258000:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624610176:0@lo:400:kworker.0 00000100:00100000:0.0:1787114938.258020:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114938.258048:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624609792 00000100:00100000:0.0:1787114938.258055:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624609792 00000100:00100000:0.0:1787114938.258102:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787114938.258131:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624609792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114938.258181:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624609792:12345-0@lo:400:kworker.0 Request processed in 52us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114938.258188:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787114938.258221:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624610304 00000100:00100000:0.0:1787114938.258225:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624610304 00000100:00100000:0.0:1787114938.258259:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787114938.258266:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624610304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114938.258297:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624610304:12345-0@lo:400:kworker.0 Request processed in 32us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114938.258302:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787114938.258453:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624609920 00000100:00100000:1.0:1787114938.258458:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624609920 00000100:00100000:1.0:1787114938.258484:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624610048 00000100:00100000:1.0:1787114938.258487:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624610048 00000100:00100000:1.0:1787114938.258830:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624610176 00000100:00100000:1.0:1787114938.258835:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624610176 00000100:00100000:1.0:1787114938.258855:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787114938.258862:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624609920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114938.258898:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624609920:12345-0@lo:400:kworker.0 Request processed in 36us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114938.258904:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787114938.258916:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787114938.258923:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624610048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114938.258955:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624610048:12345-0@lo:400:kworker.0 Request processed in 33us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114938.258961:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787114938.258971:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787114938.258977:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624610176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114938.259001:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624610176:12345-0@lo:400:kworker.0 Request processed in 26us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114938.259008:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1787114938.259046:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787114938.259050:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787114938.259075:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624609792:0@lo:400:kworker.0 00010000:00080000:1.0:1787114938.259103:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af05125df80 x1873925624610304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114938.259136:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624610304:0@lo:400:kworker.0 00000100:00100000:1.0:1787114938.259148:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b68ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624609920:0@lo:400:kworker.0 00000100:00100000:1.0:1787114938.259197:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624610176:0@lo:400:kworker.0 00000100:00100000:1.0:1787114938.259207:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b68dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624610048:0@lo:400:kworker.0 00010000:00010000:1.0:1787114938.694392:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114938.759016:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624610432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787114938.759095:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114938.759326:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624610432 00000100:00100000:3.0:1787114938.759335:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624610432 00000100:00100000:3.0:1787114938.759508:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787114938.759519:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624610432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787114938.759567:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787114938.759621:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624610432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114938.759628:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787114938.762336:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f960380 x1873925624610432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114938.762362:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624610432:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787114939.719214:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114940.747540:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787114940.890952:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 067b55fc-03d7-46d6-801a-48936d919d16 00000020:00000080:1.0:1787114940.890967:0:7483:0:(genops.c:906:class_export_put()) final put ffff8af045136800/067b55fc-03d7-46d6-801a-48936d919d16 00000020:00000080:2.0:1787114940.898287:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8af045136800/067b55fc-03d7-46d6-801a-48936d919d16 for lustre-OST0001 00000020:00000080:2.0:1787114940.905214:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af045134000 for lustre-OST0001 00010000:00010000:1.0:1787114941.777006:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787114942.442167:0:6604:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 067b55fc-03d7-46d6-801a-48936d919d16 00000020:00000080:3.0:1787114942.442183:0:6604:0:(genops.c:906:class_export_put()) final put ffff8af06f290800/067b55fc-03d7-46d6-801a-48936d919d16 00000020:00000080:1.0:1787114942.452859:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8af06f290800/067b55fc-03d7-46d6-801a-48936d919d16 for lustre-OST0000 00000020:00000080:1.0:1787114942.452976:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af06f295000 for lustre-OST0000 00010000:00010000:1.0:1787114942.789633:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114942.843817:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114942.843871:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114942.843907:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114942.843944:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602556288 00000100:00100000:1.0:1787114942.843957:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602556288 00000100:00100000:1.0:1787114942.844031:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 227 00000100:00100000:1.0:1787114942.844043:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2364:x1873925602556288:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114942.844149:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2364:x1873925602556288:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 108us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114942.844157:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 227 00000100:00100000:1.0:1787114942.844207:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602556416 00000100:00100000:1.0:1787114942.844211:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602556416 00000100:00100000:1.0:1787114942.844252:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602556544 00000100:00100000:1.0:1787114942.844255:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602556544 00000100:00100000:1.0:1787114942.844277:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 92 00000100:00100000:1.0:1787114942.844284:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602556416:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114942.844317:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602556416:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 34us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114942.844324:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 92 00000100:00100000:1.0:1787114942.844334:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 93 00000100:00100000:1.0:1787114942.844340:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+5:2364:x1873925602556544:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114942.844360:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+5:2364:x1873925602556544:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 21us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114942.844367:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 93 00000100:00080000:1.0:1787114942.844555:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787114943.365380:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624610560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787114943.365521:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114943.365768:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624610944:0@lo:400:kworker.0 00000100:00100000:1.0:1787114943.365804:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114943.365824:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787114943.365828:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624610816:0@lo:400:kworker.0 00000100:00100000:1.0:1787114943.365844:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114943.365867:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624610944 00000100:00100000:1.0:1787114943.365873:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624610944 00000100:00100000:1.0:1787114943.365931:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624610816 00000100:00100000:1.0:1787114943.365933:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624610816 00000100:00100000:1.0:1787114943.365950:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787114943.365957:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624610944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114943.366005:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624610944:12345-0@lo:400:kworker.0 Request processed in 48us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114943.366019:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787114943.366033:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787114943.366037:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624610816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114943.366056:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624610816:12345-0@lo:400:kworker.0 Request processed in 19us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114943.366060:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1787114943.366074:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787114943.366136:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624610816:0@lo:400:kworker.0 00000100:00100000:1.0:1787114943.366145:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624610944:0@lo:400:kworker.0 00000100:00100000:2.0:1787114943.366380:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624610688:0@lo:400:kworker.0 00000100:00100000:2.0:1787114943.366424:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114943.366468:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624611200:0@lo:400:kworker.0 00000100:00100000:2.0:1787114943.366500:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114943.366523:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787114943.366530:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b68dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873925624611072:0@lo:400:kworker.0 00000100:00100000:2.0:1787114943.366566:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114943.366602:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624610560 00000100:00100000:2.0:1787114943.366607:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624610560 00000100:00100000:2.0:1787114943.366653:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787114943.366661:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624610560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787114943.366703:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787114943.366743:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624610560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114943.366750:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787114943.366777:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624611072 00000100:00100000:2.0:1787114943.366781:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624611072 00000100:00100000:2.0:1787114943.366809:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787114943.366816:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873925624611072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114943.366844:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873925624611072:12345-0@lo:400:kworker.0 Request processed in 29us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114943.366848:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787114943.366863:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624610688 00000100:00100000:2.0:1787114943.366865:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624610688 00000100:00100000:2.0:1787114943.366883:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787114943.366886:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3307:x1873925624610688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114943.366906:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3307:x1873925624610688:12345-0@lo:400:kworker.0 Request processed in 19us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114943.366921:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:2.0:1787114943.366956:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787114943.366958:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787114943.366977:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b68dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873925624611072:0@lo:400:kworker.0 00000100:00100000:2.0:1787114943.366983:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624610688:0@lo:400:kworker.0 00010000:00080000:0.0:1787114943.369308:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f7d2680 x1873925624610560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114943.369350:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624610560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787114943.371298:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624611200 00000100:00100000:1.0:1787114943.371318:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624611200 00000100:00100000:1.0:1787114943.371455:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787114943.371467:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624611200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114943.371614:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624611200:12345-0@lo:400:kworker.0 Request processed in 150us (5112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114943.371624:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787114943.371684:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07b68c000 x1873925624611200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114943.371702:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624611200:0@lo:400:kworker.0 00000100:00080000:0.0:1787114943.371815:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787114943.813850:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114943.877886:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787114943.877932:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624611328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787114943.878040:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114943.878526:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624611328 00000100:00100000:2.0:1787114943.878540:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624611328 00000100:00100000:2.0:1787114943.878633:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787114943.878645:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624611328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787114943.878698:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787114943.878772:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624611328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114943.878780:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1787114943.878836:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f961c00 x1873925624611328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114943.878882:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624611328:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787114944.838637:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787114945.505978:0:10853:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787114945.865288:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114946.885394:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114947.912538:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114947.982235:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114947.982275:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114947.982305:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114947.982356:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602556928 00000100:00100000:0.0:1787114947.982365:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602556928 00000100:00100000:0.0:1787114947.982424:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602556800 00000100:00100000:0.0:1787114947.982427:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602556800 00000100:00100000:0.0:1787114947.982454:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 97 00000100:00100000:0.0:1787114947.982464:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602556928:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787114947.982559:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602556928:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 97us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114947.982567:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 97 00000100:00100000:0.0:1787114947.982585:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 98 00000100:00100000:0.0:1787114947.982591:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2362:x1873925602556800:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787114947.982616:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2362:x1873925602556800:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 25us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114947.982622:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 98 00000100:00080000:0.0:1787114947.982642:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787114947.983626:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602556672 00000100:00100000:1.0:1787114947.983636:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602556672 00000100:00100000:1.0:1787114947.983687:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 229 00000100:00100000:1.0:1787114947.983696:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602556672:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114947.983744:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602556672:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 49us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114947.983751:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 229 00000100:00100000:1.0:1787114948.486018:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b68dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624611456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787114948.486087:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114948.486182:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624611456 00000100:00100000:1.0:1787114948.486190:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624611456 00000100:00100000:2.0:1787114948.486593:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787114948.486606:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624611456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787114948.486647:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787114948.486708:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624611456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114948.486716:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787114948.491278:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624611584:0@lo:400:kworker.0 00000100:00100000:0.0:1787114948.491703:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114948.491786:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624612096:0@lo:400:kworker.0 00000100:00100000:0.0:1787114948.491830:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114948.491886:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787114948.491893:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624611712:0@lo:400:kworker.0 00000100:00100000:0.0:1787114948.491927:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114948.492002:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624611712 00000100:00100000:0.0:1787114948.492011:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624611712 00000100:00100000:0.0:1787114948.492070:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787114948.492079:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624611712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114948.492209:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624611712:12345-0@lo:400:kworker.0 Request processed in 130us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114948.493010:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624611584 00000100:00100000:2.0:1787114948.493019:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624611584 00000100:00100000:2.0:1787114948.493068:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787114948.493076:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624611584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114948.493147:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624611584:12345-0@lo:400:kworker.0 Request processed in 72us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114948.493155:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787114948.493458:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787114948.493522:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624611712:0@lo:400:kworker.0 00000100:00100000:0.0:1787114948.493534:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624611584:0@lo:400:kworker.0 00000100:00100000:2.0:1787114948.493583:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624612096 00000100:00100000:2.0:1787114948.493587:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624612096 00000100:00100000:2.0:1787114948.493626:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787114948.493633:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624612096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114948.493741:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624612096:12345-0@lo:400:kworker.0 Request processed in 107us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114948.493748:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1787114948.493774:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af0591d7480 x1873925624612096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114948.493785:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624612096:0@lo:400:kworker.0 00000100:00080000:0.0:1787114948.494174:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787114948.494179:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787114948.494191:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624611840:0@lo:400:kworker.0 00000100:00100000:2.0:1787114948.494430:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624611968:0@lo:400:kworker.0 00000100:00100000:0.0:1787114948.494788:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114948.495341:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787114948.495375:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07b68dc00 x1873925624611456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114948.495396:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b68dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624611456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787114948.495843:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624611840 00000100:00100000:0.0:1787114948.495851:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624611840 00000100:00100000:0.0:1787114948.495905:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624611968 00000100:00080000:1.0:1787114948.495907:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787114948.495908:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624611968 00000100:00080000:1.0:1787114948.495921:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787114948.495935:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787114948.495940:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787114948.495942:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624611840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114948.495947:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624611968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114948.496522:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624611968:12345-0@lo:400:kworker.0 Request processed in 574us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114948.496530:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787114948.498417:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624611968:0@lo:400:kworker.0 00000100:00100000:3.0:1787114948.506880:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624611840:0@lo:400:kworker.0 00000100:00100000:0.0:1787114948.507093:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624611840:12345-0@lo:400:kworker.0 Request processed in 11136us (12291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114948.507194:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00010000:1.0:1787114948.937817:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787114949.000734:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787114949.000755:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624612224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787114949.000832:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114949.000914:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624612224 00000100:00100000:3.0:1787114949.000923:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624612224 00000100:00100000:3.0:1787114949.001065:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787114949.001075:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624612224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787114949.001173:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787114949.001223:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624612224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114949.001242:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787114949.001362:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f961f80 x1873925624612224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114949.001380:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624612224:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1787114949.250702:0:11002:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc1726670 20000000:00000080:0.0:1787114949.250721:0:11002:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8af043102c00 uarg=0000000000000000 20000000:01000000:0.0:1787114949.250754:0:11002:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787114949.250759:0:11002:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787114949.250764:0:11002:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787114949.252059:0:11003:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787114949.252583:0:11002:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787114949.262359:0:11002:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787114949.262400:0:11002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c83e4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114949.262436:0:11002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af052364c00/0x194cd781e88c8389 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d138a expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114949.262444:0:11002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af052364a00/0x194cd781e88c8397 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8390 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114949.262451:0:11002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af041682200/0x194cd781e88c83a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c839e expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114949.262458:0:11002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af041683000/0x194cd781e88c83b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c83ac expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114949.262466:0:11002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af0429cba00/0x194cd781e88c83c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13c2 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114949.262472:0:11002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c83e4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114949.262533:0:11002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af0429cba00/0x194cd781e88c83c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13c2 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114949.262550:0:11002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af0429cba00/0x194cd781e88c83c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13c2 expref: 12 pid: 5779 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114949.262567:0:11002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11002:1873925624612352:192.168.202.10@tcp:104: 00010000:00010000:1.0:1787114949.262770:0:11002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af041683000/0x194cd781e88c83b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c83ac expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114949.262780:0:11002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af041683000/0x194cd781e88c83b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c83ac expref: 18 pid: 5780 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114949.262798:0:11002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11002:1873925624612480:0@lo:104: 00000100:00100000:1.0:1787114949.262901:0:11002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787114949.262966:0:11002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af041682200/0x194cd781e88c83a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c839e expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114949.262975:0:11002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af041682200/0x194cd781e88c83a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c839e expref: 18 pid: 5778 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114949.262984:0:11002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af045057480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11002:1873925624612608:0@lo:104: 00000100:00100000:1.0:1787114949.263006:0:11002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787114949.263034:0:11002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af052364a00/0x194cd781e88c8397 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c8390 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114949.263041:0:11002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af052364a00/0x194cd781e88c8397 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c8390 expref: 18 pid: 5779 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114949.263049:0:11002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af045056d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11002:1873925624612736:0@lo:104: 00000100:00100000:1.0:1787114949.263069:0:11002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787114949.263085:0:11002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af052364c00/0x194cd781e88c8389 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d138a expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114949.263093:0:11002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af052364c00/0x194cd781e88c8389 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d138a expref: 12 pid: 5778 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114949.263102:0:11002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af045055880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11002:1873925624612864:192.168.202.10@tcp:104: 00000100:00100000:1.0:1787114949.263381:0:11002:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0438e8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787114949.263522:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624612480 00000100:00100000:2.0:1787114949.263532:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624612480 00000100:00100000:2.0:1787114949.263579:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624612608 00000100:00100000:2.0:1787114949.263582:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624612608 00000100:00100000:2.0:1787114949.263591:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624612736 00000100:00100000:2.0:1787114949.263593:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624612736 00000100:00100000:2.0:1787114949.263606:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787114949.263614:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+5:11002:x1873925624612480:12345-0@lo:104: 00010000:00010000:2.0:1787114949.263627:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c83ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c83b3 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114949.263680:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787114949.263693:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+5:11002:x1873925624612480:12345-0@lo:104: Request processed in 80us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114949.263700:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787114949.263716:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787114949.263722:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+4:11002:x1873925624612608:12345-0@lo:104: 00010000:00010000:2.0:1787114949.263729:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c839e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c83a5 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114949.263760:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787114949.263765:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+4:11002:x1873925624612608:12345-0@lo:104: Request processed in 44us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114949.263771:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787114949.263782:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787114949.263787:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045057800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:11002:x1873925624612736:12345-0@lo:104: 00010000:00010000:2.0:1787114949.263794:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af0429cae00/0x194cd781e88c8390 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8397 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114949.263824:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787114949.263830:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045057800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:11002:x1873925624612736:12345-0@lo:104: Request processed in 43us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114949.263835:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787114949.263850:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787114949.263856:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c83ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c83b3 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114949.263864:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682400 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1787114949.263868:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c83ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c83b3 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114949.263888:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c83ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c83b3 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787114949.263896:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c83ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c83b3 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787114949.263902:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787114949.263932:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c83ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c83b3 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114949.263940:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787114949.263960:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c83ac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c83b3 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114949.263967:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af041682400/0x194cd781e88c83ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c83b3 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114949.263981:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787114949.263984:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c839e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c83a5 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114949.263991:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682000 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1787114949.263994:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c839e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c83a5 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114949.264001:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c839e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c83a5 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787114949.264006:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c839e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c83a5 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787114949.264019:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787114949.264033:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c839e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c83a5 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114949.264038:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787114949.264044:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c839e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c83a5 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114949.264051:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c839e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c83a5 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114949.264059:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787114949.264062:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af0429cae00/0x194cd781e88c8390 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8397 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114949.264068:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cae00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1787114949.264071:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af0429cae00/0x194cd781e88c8390 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c8397 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114949.264077:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af0429cae00/0x194cd781e88c8390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c8397 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787114949.264083:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af0429cae00/0x194cd781e88c8390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c8397 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787114949.264088:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787114949.264099:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af0429cae00/0x194cd781e88c8390 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8397 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114949.264105:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787114949.264151:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af0429cae00/0x194cd781e88c8390 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8397 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114949.264157:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af0429cae00/0x194cd781e88c8390 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8397 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114949.264173:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114949.264175:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114949.264177:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114949.264184:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114949.264190:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114949.264197:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787114949.264211:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624613248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787114949.264246:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114949.264283:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624613248 00000100:00100000:2.0:1787114949.264287:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624613248 00010000:00010000:2.0:1787114949.264305:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af052364a00/0x194cd781e88c8397 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8390 expref: 19 pid: 5779 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114949.264328:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787114949.264334:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3307:x1873925624613248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787114949.264344:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787114949.264351:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af052364a00/0x194cd781e88c8397 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8390 expref: 19 pid: 5779 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114949.264360:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af052364a00/0x194cd781e88c8397 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c8390 expref: 19 pid: 5779 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114949.264376:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787114949.264403:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3307:x1873925624613248:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114949.264416:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787114949.264491:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624613248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787114949.264774:0:11002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11002:1873925624612480:0@lo:104: 00000100:00100000:1.0:1787114949.264793:0:11002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af045057480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11002:1873925624612608:0@lo:104: 00010000:00010000:1.0:1787114949.264801:0:11002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af052364a00/0x194cd781e88c8397 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c8390 expref: 18 pid: 5779 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114949.264825:0:11002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af045056d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11002:1873925624612736:0@lo:104: 00000100:00100000:3.0:1787114949.265070:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624612992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787114949.265155:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114949.265188:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787114949.265194:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624613120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787114949.265221:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114949.265552:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624612992 00000100:00100000:1.0:1787114949.265559:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624612992 00010000:00010000:1.0:1787114949.265584:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af041683000/0x194cd781e88c83b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c83ac expref: 18 pid: 5780 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114949.265614:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624613120 00000100:00100000:1.0:1787114949.265617:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624613120 00010000:00010000:1.0:1787114949.265629:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af041682200/0x194cd781e88c83a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c839e expref: 19 pid: 5778 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114949.265644:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787114949.265651:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f961f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624612992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787114949.265662:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787114949.265667:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af041683000/0x194cd781e88c83b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c83ac expref: 19 pid: 5780 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114949.265676:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af041683000/0x194cd781e88c83b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c83ac expref: 19 pid: 5780 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114949.265690:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af041683000/0x194cd781e88c83b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c83ac expref: 19 pid: 5780 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114949.265706:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787114949.265736:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f961f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:3308:x1873925624612992:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114949.265754:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787114949.265768:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787114949.265774:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f961180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:3308:x1873925624613120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787114949.265782:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787114949.265787:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af041682200/0x194cd781e88c83a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c839e expref: 17 pid: 5778 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114949.265795:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af041682200/0x194cd781e88c83a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c839e expref: 17 pid: 5778 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114949.265804:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af041682200/0x194cd781e88c83a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c839e expref: 17 pid: 5778 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114949.265888:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787114949.265912:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f961180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:3308:x1873925624613120:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114949.265919:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787114949.265991:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624613120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787114949.265999:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624612992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787114949.281017:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114949.281061:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114949.281157:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602557056 00000100:00100000:3.0:1787114949.281167:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602557056 00010000:00010000:3.0:1787114949.281201:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af0429cba00/0x194cd781e88c83c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13c2 expref: 13 pid: 5779 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114949.281227:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602557184 00000100:00100000:3.0:1787114949.281229:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602557184 00010000:00010000:3.0:1787114949.281237:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af052364c00/0x194cd781e88c8389 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d138a expref: 14 pid: 5778 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114949.281252:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 28 00000100:00100000:3.0:1787114949.281258:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+14:2364:x1873925602557056:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787114949.281269:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787114949.281283:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af0429cba00/0x194cd781e88c83c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13c2 expref: 14 pid: 5779 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114949.281293:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af0429cba00/0x194cd781e88c83c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13c2 expref: 14 pid: 5779 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114949.281310:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787114949.281354:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+14:2364:x1873925602557056:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 96us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114949.281373:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 28 00000100:00100000:3.0:1787114949.281390:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 29 00000100:00100000:3.0:1787114949.281394:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2363:x1873925602557184:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787114949.281399:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787114949.281403:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af052364c00/0x194cd781e88c8389 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d138a expref: 13 pid: 5778 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114949.281409:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af052364c00/0x194cd781e88c8389 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d138a expref: 13 pid: 5778 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114949.281418:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c83e4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114949.281424:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c83e4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114949.281435:0:5772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c83e4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114949.281440:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c83e4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114949.281445:0:5772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c83e4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114949.281449:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c83e4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114949.281453:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1800 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:3.0:1787114949.281460:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c83e4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114949.281466:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c83e4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114949.281471:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c83e4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114949.281477:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787114949.281489:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2363:x1873925602557184:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 95us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114949.281494:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 29 00010000:00010000:2.0:1787114949.283295:0:11002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af0429cba00/0x194cd781e88c83c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13c2 expref: 12 pid: 5779 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114949.283326:0:11002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11002:1873925624612352:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787114949.283395:0:11002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af052364c00/0x194cd781e88c8389 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d138a expref: 11 pid: 5778 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114949.283408:0:11002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af045055880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11002:1873925624612864:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787114949.283440:0:11002:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c83e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114949.283451:0:11002:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c83e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114949.283456:0:11002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c83e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114949.283462:0:11002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c83e4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114949.957461:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114950.523219:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114950.523275:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602557312 00000100:00100000:0.0:1787114950.523285:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602557312 00000100:00100000:0.0:1787114950.523334:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 231 00000100:00100000:0.0:1787114950.523342:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+11:5579:x1873925602557312:12345-192.168.202.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787114950.523363:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114950.523384:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af052364c00/0x194cd781e88c83eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d13ec expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114950.523417:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af052364c00/0x194cd781e88c83eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13ec expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114950.523434:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af052364c00/0x194cd781e88c83eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13ec expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114950.523447:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052364c00, rc 0) 00000100:00100000:0.0:1787114950.523526:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:5579:x1873925602557312:12345-192.168.202.10@tcp:101:ll_cfg_requeue.0 Request processed in 184us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114950.523538:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 231 00000100:00100000:3.0:1787114950.526339:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114950.526474:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602557440 00000100:00100000:0.0:1787114950.526496:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602557440 00000100:00100000:0.0:1787114950.526562:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 232 00000100:00100000:0.0:1787114950.526575:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:5579:x1873925602557440:12345-192.168.202.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787114950.526961:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:5579:x1873925602557440:12345-192.168.202.10@tcp:501:ll_cfg_requeue.0 Request processed in 388us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114950.526969:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 232 00000100:00100000:0.0:1787114950.529912:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114950.530013:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602557568 00000100:00100000:2.0:1787114950.530028:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602557568 00000100:00100000:2.0:1787114950.530222:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 233 00000100:00100000:2.0:1787114950.530232:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:5579:x1873925602557568:12345-192.168.202.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787114950.530501:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:5579:x1873925602557568:12345-192.168.202.10@tcp:503:ll_cfg_requeue.0 Request processed in 260us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114950.530511:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 233 00000100:00100000:0.0:1787114950.536661:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114950.537391:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602557696 00000100:00100000:3.0:1787114950.537423:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602557696 00000100:00100000:3.0:1787114950.537534:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 234 00000100:00100000:3.0:1787114950.537546:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:5579:x1873925602557696:12345-192.168.202.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787114950.537568:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787114950.537591:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af0429ca600/0x194cd781e88c83f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d13f3 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114950.537630:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af0429ca600/0x194cd781e88c83f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13f3 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114950.537641:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af0429ca600/0x194cd781e88c83f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13f3 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114950.537662:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429ca600, rc 0) 00000100:00100000:3.0:1787114950.537741:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:5579:x1873925602557696:12345-192.168.202.10@tcp:101:ll_cfg_requeue.0 Request processed in 196us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114950.537749:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 234 00000100:00100000:1.0:1787114950.544449:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114950.544932:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602557824 00000100:00100000:2.0:1787114950.545158:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602557824 00000100:00100000:2.0:1787114950.548735:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 235 00000100:00100000:2.0:1787114950.548770:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:5579:x1873925602557824:12345-192.168.202.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787114950.552288:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:5579:x1873925602557824:12345-192.168.202.10@tcp:501:ll_cfg_requeue.0 Request processed in 3504us (7832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114950.552306:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 235 00000100:00100000:0.0:1787114950.564234:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114950.564506:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602557952 00000100:00100000:1.0:1787114950.564517:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602557952 00000100:00100000:1.0:1787114950.564627:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 236 00000100:00100000:1.0:1787114950.564640:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:5579:x1873925602557952:12345-192.168.202.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787114950.565863:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:5579:x1873925602557952:12345-192.168.202.10@tcp:503:ll_cfg_requeue.0 Request processed in 1222us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114950.565884:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 236 00010000:00010000:2.0:1787114950.981400:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787114951.237844:0:5782:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787114951.237853:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af07b581000 from 7 10000000:01000000:1.0:1787114951.237859:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787114951.237917:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0400/0x194cd781e88c83f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114951.237929:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0400/0x194cd781e88c83f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114951.237940:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0400/0x194cd781e88c83f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114951.237968:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af045054000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624613376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787114951.238057:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114951.238139:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0438e8540 going to sleep for 11 seconds 00000100:00100000:0.0:1787114951.238167:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624613376 00000100:00100000:0.0:1787114951.238175:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624613376 00000100:00100000:0.0:1787114951.238244:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787114951.238256:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:5782:x1873925624613376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787114951.238272:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114951.238287:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af052364400/0x194cd781e88c8400 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c83f9 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114951.238311:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af052364400/0x194cd781e88c8400 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c83f9 expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114951.238321:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af052364400/0x194cd781e88c8400 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c83f9 expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114951.238330:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052364400, rc 0) 00000100:00100000:2.0:1787114951.238450:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624613376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114951.238457:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787114951.240193:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af045054000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624613376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787114951.240219:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0400/0x194cd781e88c83f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8400 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114951.240231:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0400/0x194cd781e88c83f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8400 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114951.240310:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af045054000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624613504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787114951.240354:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114951.240389:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0438e8540 going to sleep for 11 seconds 00000100:00100000:2.0:1787114951.242163:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624613504 00000100:00100000:2.0:1787114951.242175:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624613504 00000100:00100000:2.0:1787114951.242228:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787114951.242236:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624613504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787114951.242650:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624613504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 414us (2294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114951.242659:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787114951.242749:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af045054000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624613504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787114951.242814:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af045054000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624613632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787114951.242857:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114951.242892:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0438e8540 going to sleep for 11 seconds 00000100:00100000:2.0:1787114951.243066:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624613632 00000100:00100000:2.0:1787114951.243071:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624613632 00000100:00100000:2.0:1787114951.247572:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787114951.247590:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624613632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787114951.247854:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624613632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 269us (4995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114951.247863:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787114951.248341:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af045054000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624613632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787114951.251647:0:11047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787114951.251807:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787114951.251841:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787114951.251857:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0400/0x194cd781e88c83f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8400 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114951.251871:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0400/0x194cd781e88c83f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8400 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787114951.251883:0:5782:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787114951.251886:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af06f41d000 from 7 10000000:01000000:1.0:1787114951.251889:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787114951.251935:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c8407 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114951.251943:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c8407 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114951.251954:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c8407 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114951.251982:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af045057100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624613760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787114951.252076:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114951.252156:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0438e8000 going to sleep for 11 seconds 00000100:00100000:2.0:1787114951.252301:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624613760 00000100:00100000:2.0:1787114951.252312:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624613760 00000100:00100000:2.0:1787114951.252374:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787114951.252385:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624613760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787114951.252404:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114951.252635:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af042cb3a00/0x194cd781e88c840e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8407 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114951.252663:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af042cb3a00/0x194cd781e88c840e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8407 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114951.252675:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af042cb3a00/0x194cd781e88c840e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8407 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114951.252684:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3a00, rc 0) 00000100:00100000:2.0:1787114951.252748:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624613760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 363us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114951.252774:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787114951.252908:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af045057100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624613760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787114951.252924:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c8407 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c840e expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114951.252941:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c8407 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c840e expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114951.252996:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af045057100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624613888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787114951.253023:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114951.253055:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0438e8000 going to sleep for 11 seconds 00000100:00100000:2.0:1787114951.253198:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624613888 00000100:00100000:2.0:1787114951.253203:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624613888 00000100:00100000:2.0:1787114951.253235:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787114951.253241:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624613888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787114951.253683:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624613888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 441us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114951.253691:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787114951.254043:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af045057100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624613888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787114951.254083:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f963480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624614016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787114951.254146:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114951.254172:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af05129d600 going to sleep for 11 seconds 00000100:00100000:2.0:1787114951.254172:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624614016 00000100:00100000:2.0:1787114951.254177:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624614016 00000100:00100000:2.0:1787114951.254210:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787114951.254218:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624614016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787114951.257227:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624614016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2999us (3070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114951.257242:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787114951.259381:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f963480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624614016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787114951.264329:0:11050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787114951.265845:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787114951.265875:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787114951.265887:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c8407 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c840e expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114951.265899:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c8407 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c840e expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787114951.265911:0:5782:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787114951.265914:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af05032f000 from 7 10000000:01000000:1.0:1787114951.265917:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787114951.265962:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1c00/0x194cd781e88c8415 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114951.265971:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1c00/0x194cd781e88c8415 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114951.265983:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1c00/0x194cd781e88c8415 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114951.266008:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af045054e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624614144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787114951.266087:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114951.266155:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624614144 00000100:00100000:1.0:1787114951.266162:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0438e8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787114951.266168:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624614144 00000100:00100000:3.0:1787114951.266227:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787114951.266236:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624614144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787114951.266249:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787114951.266262:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af0429cbe00/0x194cd781e88c841c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8415 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114951.266286:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af0429cbe00/0x194cd781e88c841c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8415 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114951.266296:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af0429cbe00/0x194cd781e88c841c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8415 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114951.266306:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429cbe00, rc 0) 00000100:00100000:3.0:1787114951.266352:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:5782:x1873925624614144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114951.266359:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787114951.266560:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af045054e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624614144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787114951.266576:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1c00/0x194cd781e88c8415 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c841c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114951.266589:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1c00/0x194cd781e88c8415 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c841c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114951.266639:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07fb96680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624614272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787114951.266677:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114951.266712:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0585fef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787114951.266757:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624614272 00000100:00100000:3.0:1787114951.266762:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624614272 00000100:00100000:3.0:1787114951.266805:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787114951.266821:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:5782:x1873925624614272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787114951.267080:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:5782:x1873925624614272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114951.267087:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787114951.267205:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07fb96680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624614272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787114951.267236:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f963480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624614400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787114951.267272:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114951.267293:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af05129d000 going to sleep for 11 seconds 00000100:00100000:0.0:1787114951.267372:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624614400 00000100:00100000:0.0:1787114951.267377:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624614400 00000100:00100000:0.0:1787114951.267394:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787114951.267401:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:5782:x1873925624614400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787114951.267555:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:5782:x1873925624614400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114951.267562:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787114951.271248:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f963480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624614400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787114951.271945:0:11052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787114951.272009:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787114951.272025:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787114951.272048:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1c00/0x194cd781e88c8415 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c841c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114951.272060:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1c00/0x194cd781e88c8415 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c841c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114952.009611:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114953.029352:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114953.084531:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114953.084572:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114953.084598:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114953.084624:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602558080 00000100:00100000:3.0:1787114953.084703:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602558208 00000100:00100000:3.0:1787114953.084719:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602558208 00000100:00100000:3.0:1787114953.084777:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602558336 00000100:00100000:3.0:1787114953.084781:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602558336 00000100:00100000:3.0:1787114953.084817:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 102 00000100:00100000:3.0:1787114953.084826:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2362:x1873925602558208:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787114953.084899:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2362:x1873925602558208:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 74us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114953.084906:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 102 00000100:00100000:3.0:1787114953.084924:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 103 00000100:00100000:3.0:1787114953.084931:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602558336:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787114953.084954:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602558336:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 25us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114953.084960:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 103 00000100:00100000:1.0:1787114953.085575:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602558080 00000100:00100000:1.0:1787114953.085612:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 246 00000100:00100000:1.0:1787114953.085619:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602558080:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114953.085848:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602558080:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 227us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114953.085855:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 246 00000100:00080000:1.0:1787114953.085886:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787114953.607391:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787114953.607414:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af045056680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624614528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787114953.607495:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114953.607562:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624614528 00000100:00100000:1.0:1787114953.607570:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624614528 00000100:00100000:1.0:1787114953.607637:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787114953.607647:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624614528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787114953.607683:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787114953.607742:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624614528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114953.607749:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1787114953.607769:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787114953.607817:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af045056680 x1873925624614528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114953.607835:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af045056680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624614528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787114953.616709:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873925624615040:0@lo:400:kworker.0 00000100:00100000:2.0:1787114953.616722:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624614656:0@lo:400:kworker.0 00000100:00100000:1.0:1787114953.616799:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624614784:0@lo:400:kworker.0 00000100:00100000:2.0:1787114953.620425:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114953.620493:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624615168:0@lo:400:kworker.0 00000100:00100000:2.0:1787114953.620536:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114953.620595:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624614656 00000100:00100000:2.0:1787114953.620603:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624614656 00000100:00100000:2.0:1787114953.621357:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787114953.621367:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624614656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114953.621423:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624614656:12345-0@lo:400:kworker.0 Request processed in 58us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114953.621431:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787114953.621507:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624614656:0@lo:400:kworker.0 00000100:00100000:2.0:1787114953.621550:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624614912:0@lo:400:kworker.0 00000100:00100000:2.0:1787114953.621579:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114953.622313:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624614912 00000100:00100000:2.0:1787114953.622320:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624614912 00000100:00100000:2.0:1787114953.622367:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787114953.622375:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624614912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114953.622421:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624614912:12345-0@lo:400:kworker.0 Request processed in 47us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114953.622427:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787114953.622479:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624614912:0@lo:400:kworker.0 00000100:00100000:2.0:1787114953.622517:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624615168 00000100:00100000:2.0:1787114953.622521:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624615168 00000100:00100000:2.0:1787114953.622555:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787114953.622561:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624615168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114953.622597:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624615168:12345-0@lo:400:kworker.0 Request processed in 36us (2061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114953.622602:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114953.622604:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1787114953.622622:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787114953.622622:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624614784 00000100:00100000:1.0:1787114953.622626:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624614784 00000100:00100000:1.0:1787114953.622650:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787114953.622656:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624614784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114953.622688:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624614784:12345-0@lo:400:kworker.0 Request processed in 32us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114953.622694:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787114953.622722:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624614784:0@lo:400:kworker.0 00010000:00080000:1.0:1787114953.623281:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f960000 x1873925624615168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114953.623294:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624615168:0@lo:400:kworker.0 00000100:00080000:2.0:1787114953.623333:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787114953.642635:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114953.642739:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624615040 00000100:00100000:3.0:1787114953.642749:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624615040 00000100:00100000:3.0:1787114953.642817:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787114953.642828:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873925624615040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114953.642901:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873925624615040:12345-0@lo:400:kworker.0 Request processed in 74us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114953.642908:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1787114953.642931:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787114953.643590:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873925624615040:0@lo:400:kworker.0 00010000:00010000:2.0:1787114954.053270:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114954.121805:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af045054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624615296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787114954.121885:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114954.121990:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624615296 00000100:00100000:1.0:1787114954.122000:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624615296 00000100:00100000:1.0:1787114954.122061:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787114954.122074:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624615296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787114954.122142:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787114954.122195:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624615296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114954.122205:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1787114954.122270:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af045054a80 x1873925624615296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114954.122293:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af045054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624615296:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787114954.707241:0:11201:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg210-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787114955.077364:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114956.101433:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114957.134371:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114958.153559:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114958.202374:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114958.209028:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602558592 00000100:00100000:2.0:1787114958.209044:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602558592 00000100:00100000:2.0:1787114958.209213:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 107 00000100:00100000:2.0:1787114958.209225:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2361:x1873925602558592:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787114958.209304:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2361:x1873925602558592:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 82us (6941us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114958.209312:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 107 00000100:00100000:2.0:1787114958.212349:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114958.212405:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114958.212445:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602558720 00000100:00100000:2.0:1787114958.212455:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602558720 00000100:00100000:3.0:1787114958.212505:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602558464 00000100:00100000:3.0:1787114958.212510:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602558464 00000100:00100000:3.0:1787114958.212552:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 248 00000100:00100000:3.0:1787114958.212561:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602558464:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787114958.212860:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602558464:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 298us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114958.212868:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 248 00000100:00080000:1.0:1787114958.216709:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787114958.217287:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 108 00000100:00100000:2.0:1787114958.217303:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602558720:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787114958.217395:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602558720:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 85us (4977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114958.217403:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 108 00000100:00100000:0.0:1787114958.730084:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624615424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787114958.730189:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114958.730597:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624615424 00000100:00100000:2.0:1787114958.730606:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624615424 00000100:00100000:2.0:1787114958.730674:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787114958.730684:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624615424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787114958.730719:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787114958.730773:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624615424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114958.730780:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1787114958.730818:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f6c1500 x1873925624615424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114958.730837:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624615424:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787114958.730995:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787114958.732601:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624615552:0@lo:400:kworker.0 00000100:00100000:1.0:1787114958.732658:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114958.732728:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624615552 00000100:00100000:2.0:1787114958.732734:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624615552 00000100:00100000:2.0:1787114958.732779:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787114958.732787:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3307:x1873925624615552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114958.733099:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624615936:0@lo:400:kworker.0 00000100:00100000:3.0:1787114958.733147:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114958.733373:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3307:x1873925624615552:12345-0@lo:400:kworker.0 Request processed in 586us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114958.733393:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787114958.733434:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624615936 00000100:00100000:2.0:1787114958.733438:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624615936 00000100:00100000:2.0:1787114958.733594:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787114958.733602:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624615936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114958.733644:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624615936:12345-0@lo:400:kworker.0 Request processed in 43us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114958.733651:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787114958.733697:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624615936:0@lo:400:kworker.0 00000100:00080000:3.0:1787114958.733806:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787114958.734053:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624615552:0@lo:400:kworker.0 00000100:00100000:1.0:1787114958.734076:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624615680:0@lo:400:kworker.0 00000100:00100000:1.0:1787114958.734133:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114958.734154:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787114958.734161:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624615808:0@lo:400:kworker.0 00000100:00100000:1.0:1787114958.734183:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114958.734329:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624615680 00000100:00100000:3.0:1787114958.734334:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624615680 00000100:00100000:3.0:1787114958.734364:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624615808 00000100:00100000:3.0:1787114958.734367:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624615808 00000100:00100000:3.0:1787114958.734389:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787114958.734395:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624615680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114958.734442:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624615680:12345-0@lo:400:kworker.0 Request processed in 46us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114958.734448:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787114958.734461:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787114958.734467:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624615808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114958.734492:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624615808:12345-0@lo:400:kworker.0 Request processed in 26us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114958.734498:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1787114958.734512:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787114958.734601:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624615808:0@lo:400:kworker.0 00000100:00100000:1.0:1787114958.734611:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624615680:0@lo:400:kworker.0 00000100:00100000:2.0:1787114958.734853:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787114958.734862:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624616064:0@lo:400:kworker.0 00000100:00100000:2.0:1787114958.734892:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114958.734966:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624616064 00000100:00100000:0.0:1787114958.734972:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624616064 00000100:00080000:3.0:1787114958.735130:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787114958.735204:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787114958.735213:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624616064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114958.735268:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624616064:12345-0@lo:400:kworker.0 Request processed in 56us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114958.735274:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787114958.735425:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af06c158e00 x1873925624616064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114958.735437:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624616064:0@lo:400:kworker.0 00000001:02000400:0.0:1787114958.941003:0:11301:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 00:49:17 (1787114957) === 00000100:00100000:3.0:1787114959.127454:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114959.127502:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114959.127572:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602558976 00000100:00100000:1.0:1787114959.127583:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602558976 00000100:00100000:1.0:1787114959.127639:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:1.0:1787114959.127649:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:9665:x1873925602558976:12345-192.168.202.10@tcp:700:mkdir.0 00000100:00100000:1.0:1787114959.127733:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:9665:x1873925602558976:12345-192.168.202.10@tcp:700:mkdir.0 Request processed in 86us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114959.127742:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:2.0:1787114959.128129:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602558848 00000100:00100000:2.0:1787114959.128135:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602558848 00000100:00100000:2.0:1787114959.128168:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 14 00000100:00100000:2.0:1787114959.128177:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602558848:12345-192.168.202.10@tcp:41:mkdir.0 00000004:00000024:2.0:1787114959.128209:0:5785:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787114959.128265:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602558848:12345-192.168.202.10@tcp:41:mkdir.0 Request processed in 89us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114959.128272:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 14 00000100:00100000:3.0:1787114959.131492:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114959.132527:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602559232 00000100:00100000:2.0:1787114959.132540:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602559232 00000100:00100000:2.0:1787114959.132601:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15 00000100:00100000:2.0:1787114959.132611:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:9665:x1873925602559232:12345-192.168.202.10@tcp:36:mkdir.0 00010000:00010000:2.0:1787114959.132667:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787114959.132737:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8304 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1375 expref: 6 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.132757:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af044d99e00) 00010000:00010000:2.0:1787114959.132771:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787114959.133181:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c8423 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.133196:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c8423 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.133207:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c8423 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.133243:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c842a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.133250:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c842a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.133257:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c842a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787114959.134533:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787114959.134550:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c8423 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.134559:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c8423 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.134565:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c8423 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.134571:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787114959.134575:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c8423 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.134583:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c8423 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.134597:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0514c6800) 00010000:00010000:2.0:1787114959.134601:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787114959.134606:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c8423 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.134622:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c8423 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787114959.134642:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d1c0506b reply state 00000000d313d064 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c842a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114959.134651:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787114959.134802:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:9665:x1873925602559232:12345-192.168.202.10@tcp:36:mkdir.0 Request processed in 2189us (3314us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787114959.134812:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15 00010000:00010000:0.0:1787114959.139951:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c842a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.139983:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c842a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.139991:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c842a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.139997:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114959.140002:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c842a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.140009:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c842a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.140028:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8af0514c6f00) 00010000:00010000:0.0:1787114959.140031:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114959.140036:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c842a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.140041:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c842a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114959.154094:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114959.159262:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602559360 00000100:00100000:3.0:1787114959.159277:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602559360 00000100:00100000:2.0:1787114959.159533:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16 00000100:00100000:2.0:1787114959.159545:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:9666:x1873925602559360:12345-192.168.202.10@tcp:101:chmod.0 00010000:00010000:2.0:1787114959.159575:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114959.159605:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c8431 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d13fa expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.159688:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3200/0x194cd781e88c8438 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.159706:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3200/0x194cd781e88c8438 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.159718:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3200/0x194cd781e88c8438 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787114959.159786:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787114959.159791:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787114959.159835:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3200/0x194cd781e88c8438 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.159881:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c8431 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13fa expref: 8 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.161272:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3200/0x194cd781e88c8438 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13fa expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.161298:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0514c6800) 00010000:00010000:2.0:1787114959.161301:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787114959.161305:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3200, rc 0) 00000100:00100000:2.0:1787114959.161404:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:9666:x1873925602559360:12345-192.168.202.10@tcp:101:chmod.0 Request processed in 1858us (7312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114959.161436:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16 00000100:00100000:0.0:1787114959.166953:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114959.168384:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602559616 00000100:00100000:3.0:1787114959.168398:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602559616 00000100:00100000:3.0:1787114959.168469:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17 00000100:00100000:3.0:1787114959.168479:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:9666:x1873925602559616:12345-192.168.202.10@tcp:36:chmod.0 00010000:00010000:3.0:1787114959.168531:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787114959.168557:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3200/0x194cd781e88c8438 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13fa expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114959.168573:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0514c6800) 00010000:00010000:3.0:1787114959.168585:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787114959.168611:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca200/0x194cd781e88c843f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114959.168624:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca200/0x194cd781e88c843f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114959.168634:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca200/0x194cd781e88c843f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787114959.168934:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009457cad3 reply state 00000000034f2842 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca200/0x194cd781e88c843f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114959.168957:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787114959.168973:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787114959.169075:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:9666:x1873925602559616:12345-192.168.202.10@tcp:36:chmod.0 Request processed in 596us (2127us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787114959.169083:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17 00010000:00010000:3.0:1787114959.177790:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca200/0x194cd781e88c843f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114959.177814:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca200/0x194cd781e88c843f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114959.177823:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca200/0x194cd781e88c843f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114959.177829:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429ca200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787114959.177835:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca200/0x194cd781e88c843f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114959.177843:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca200/0x194cd781e88c843f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114959.177860:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af044d99c00) 00010000:00010000:3.0:1787114959.177864:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787114959.177893:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca200/0x194cd781e88c843f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114959.177901:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca200/0x194cd781e88c843f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.188788:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114959.204373:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114959.204845:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602559744 00000100:00100000:0.0:1787114959.204856:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602559744 00000100:00100000:0.0:1787114959.204952:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 18 00000100:00100000:0.0:1787114959.204964:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:9667:x1873925602559744:12345-192.168.202.10@tcp:101:chown.0 00010000:00010000:0.0:1787114959.204986:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114959.205008:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365400/0x194cd781e88c8446 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1401 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.205083:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c844d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.205095:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c844d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.205177:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c844d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787114959.205240:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787114959.205245:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787114959.205285:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c844d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.205310:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365400/0x194cd781e88c8446 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1401 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.205324:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c844d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1401 expref: 8 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.205332:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af051ecbb00) 00010000:00010000:0.0:1787114959.205334:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787114959.205338:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052365000, rc 0) 00000100:00100000:0.0:1787114959.205419:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:9667:x1873925602559744:12345-192.168.202.10@tcp:101:chown.0 Request processed in 448us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114959.205427:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 18 00000100:00100000:2.0:1787114959.207878:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114959.207971:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602559872 00000100:00100000:0.0:1787114959.207979:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602559872 00000100:00100000:0.0:1787114959.208073:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00100000:0.0:1787114959.208083:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:9667:x1873925602559872:12345-192.168.202.10@tcp:101:chown.0 00010000:00010000:0.0:1787114959.208102:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114959.208591:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c8454 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1408 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.208658:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c845b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.208673:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c845b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.208685:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c845b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.208700:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c8462 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.208708:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c8462 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.208715:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c8462 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.208816:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8469 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.208824:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.208831:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787114959.208884:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787114959.208888:0:7216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787114959.208911:0:7216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.208923:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c845b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.208930:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c845b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.208937:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c845b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.208942:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364a00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114959.208947:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c845b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.208954:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c845b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.208967:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af051ecbb00) 00010000:00010000:0.0:1787114959.208970:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114959.208974:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c845b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.208980:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c845b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.208991:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c8462 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.209007:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c8462 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.209013:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c8462 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.209018:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114959.209021:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c8462 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.209027:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c8462 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.209048:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8af051ecbf00) 00010000:00010000:0.0:1787114959.209051:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114959.209054:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c8462 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.209060:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c8462 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.209089:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c8454 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1408 expref: 10 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.209102:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8469 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1408 expref: 9 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.209313:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8af051ecb100) 00010000:00010000:0.0:1787114959.209316:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787114959.209324:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040031600, rc 0) 00000100:00100000:0.0:1787114959.209504:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:9667:x1873925602559872:12345-192.168.202.10@tcp:101:chown.0 Request processed in 1421us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114959.209511:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00100000:3.0:1787114959.212915:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114959.214816:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602560128 00000100:00100000:2.0:1787114959.214836:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602560128 00000100:00100000:2.0:1787114959.214948:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 20 00000100:00100000:2.0:1787114959.214959:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:9667:x1873925602560128:12345-192.168.202.10@tcp:36:chown.0 00010000:00010000:2.0:1787114959.215014:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787114959.215055:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8469 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1408 expref: 9 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.215076:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8af051ecb100) 00010000:00010000:2.0:1787114959.215095:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787114959.215317:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8470 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.215339:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.215352:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114959.237267:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af045056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624616192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787114959.237337:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114959.237499:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624616192 00000100:00100000:0.0:1787114959.237508:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624616192 00000100:00100000:0.0:1787114959.237562:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787114959.237571:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624616192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787114959.237602:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787114959.238739:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624616192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1165us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114959.238748:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1787114959.238863:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af045056300 x1873925624616192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114959.238883:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af045056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624616192:0@lo:13:osp-pre-1-0.0 00000004:00010000:2.0:1787114959.261878:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000da24e697 reply state 00000000c561a016 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787114959.261920:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000100:00100000:2.0:1787114959.261923:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787114959.262127:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1787114959.262236:0:5785:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787114959.262259:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:9667:x1873925602560128:12345-192.168.202.10@tcp:36:chown.0 Request processed in 47299us (49350us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787114959.262268:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 20 00010000:00010000:0.0:1787114959.262361:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.262371:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8470 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.262380:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.262753:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114959.262759:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.262766:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8470 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.262781:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:0.0:1787114959.262784:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787114959.262798:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8470 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.262804:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8470 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114959.277429:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114959.277843:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602560256 00000100:00100000:2.0:1787114959.277854:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602560256 00000100:00100000:2.0:1787114959.277916:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 21 00000100:00100000:2.0:1787114959.277926:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:9668:x1873925602560256:12345-192.168.202.10@tcp:101:touch.500 00010000:00010000:2.0:1787114959.277962:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114959.277982:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c8477 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d140f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787114959.289721:0:5787:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 11686us 00010000:00010000:1.0:1787114959.302782:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c847e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.302807:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c847e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.302820:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c847e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.302838:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8485 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.302845:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.302852:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.303315:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c848c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.303324:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c848c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.303332:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c848c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787114959.303432:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787114959.303437:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787114959.303533:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c848c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.303546:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c847e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.303552:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c847e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.303558:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c847e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.303564:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787114959.303568:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c847e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.303575:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c847e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.303588:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af051ecbb00) 00010000:00010000:1.0:1787114959.303590:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787114959.303594:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c847e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.303600:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c847e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.303610:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.303638:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8485 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.303644:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8485 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.303650:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0800 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787114959.303653:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8485 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.303659:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8485 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.303667:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8af0510d6600) 00010000:00010000:1.0:1787114959.303669:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787114959.303672:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8485 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.303678:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8485 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.303715:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c8477 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d140f expref: 8 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.303730:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c848c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d140f expref: 7 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114959.303738:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8af0510d6500) 00010000:00010000:1.0:1787114959.303740:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787114959.303749:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a1000, rc 0) 00000100:00100000:1.0:1787114959.303837:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:9668:x1873925602560256:12345-192.168.202.10@tcp:101:touch.500 Request processed in 25911us (26426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114959.303846:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 21 00000100:00100000:1.0:1787114959.310437:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114959.310505:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602560512 00000100:00100000:0.0:1787114959.310517:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602560512 00000100:00100000:0.0:1787114959.310583:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 22 00000100:00100000:0.0:1787114959.310594:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:9668:x1873925602560512:12345-192.168.202.10@tcp:101:touch.500 00010000:00010000:0.0:1787114959.310625:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114959.310649:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c8493 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1416 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.310963:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c849a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.310978:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c849a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.310989:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c849a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.311048:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c84a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.311056:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c84a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.311063:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c84a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787114959.311905:0:5786:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787114959.312164:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c84a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.312174:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c84a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.312182:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c84a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.312215:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c849a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.312222:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c849a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.312228:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c849a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.312234:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040031000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114959.312238:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c849a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.312246:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c849a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.312257:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8af0510d6500) 00010000:00010000:0.0:1787114959.312260:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114959.312264:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c849a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.312281:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c849a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787114959.312293:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001cd53486 reply state 0000000043b52530 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c84a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114959.312301:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787114959.312333:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c8493 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1416 expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.312348:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c84a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1416 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.312355:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8af051ecbf00) 00010000:00010000:0.0:1787114959.312357:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787114959.312360:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030c00, rc 0) 00000100:00100000:0.0:1787114959.312437:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+10:9668:x1873925602560512:12345-192.168.202.10@tcp:101:touch.500 Request processed in 1845us (2010us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787114959.312446:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 22 00010000:00010000:0.0:1787114959.314074:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c84a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.314089:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c84a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.314096:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c84a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.314102:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030a00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114959.314223:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c84a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.314231:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c84a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.314244:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7eaa65ec (ffff8af051ecb500) 00010000:00010000:0.0:1787114959.314247:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114959.314251:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c84a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.314257:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c84a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114959.321510:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114959.321824:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602560768 00000100:00100000:0.0:1787114959.321834:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602560768 00000100:00100000:0.0:1787114959.321894:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 23 00000100:00100000:0.0:1787114959.321905:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:9668:x1873925602560768:12345-192.168.202.10@tcp:36:touch.500 00010000:00010000:0.0:1787114959.321969:0:7216:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787114959.321994:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c84a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1416 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.322015:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8af051ecbf00) 00010000:00010000:0.0:1787114959.322026:0:7216:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787114959.322068:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c84b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.322082:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c84b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.322093:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c84b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787114959.322270:0:7216:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f9849eb9 reply state 000000000c7335df transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c84b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114959.322280:0:7216:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787114959.322361:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+10:9668:x1873925602560768:12345-192.168.202.10@tcp:36:touch.500 Request processed in 458us (863us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787114959.322368:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 23 00010000:00010000:0.0:1787114959.324909:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c84b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.324925:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c84b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.324932:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c84b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.324939:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114959.324943:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c84b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.324951:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c84b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.324966:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8af051ecb700) 00010000:00010000:0.0:1787114959.324969:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114959.324973:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c84b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.324991:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c84b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114959.325596:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114959.325732:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602560896 00000100:00100000:0.0:1787114959.325742:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602560896 00000100:00100000:0.0:1787114959.325798:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 24 00000100:00100000:0.0:1787114959.325807:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:9668:x1873925602560896:12345-192.168.202.10@tcp:101:touch.500 00010000:00010000:0.0:1787114959.325830:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114959.325848:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c84bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d141d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.325906:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c84bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d141d expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.325918:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c84bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d141d expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.325937:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:0.0:1787114959.325939:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787114959.325942:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030400, rc 0) 00000100:00100000:0.0:1787114959.326002:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+10:9668:x1873925602560896:12345-192.168.202.10@tcp:101:touch.500 Request processed in 197us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114959.326010:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 24 00000100:00100000:3.0:1787114959.331459:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114959.331748:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602561024 00000100:00100000:2.0:1787114959.331758:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602561024 00000100:00100000:2.0:1787114959.331834:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16 00000100:00100000:2.0:1787114959.331840:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1873925602561024:12345-192.168.202.10@tcp:8:touch.500 00010000:00080000:2.0:1787114959.331878:0:6577:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:2.0:1787114959.331902:0:6577:0:(genops.c:1406:class_connect()) connect: client 6aef9ffe-3b7b-498c-9a5a-a012c6970297, cookie 0x194cd781e88c84c4 00002000:00100000:2.0:1787114959.331912:0:6577:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6aef9ffe-3b7b-498c-9a5a-a012c6970297/ffff8af07fb01000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113803 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787114959.331920:0:6577:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787114959.332159:0:6577:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787114959.332183:0:6577:0:(import.c:65:import_set_state_nolock()) ffff8af07fb04800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787114959.332252:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2360:x1873925602561024:12345-192.168.202.10@tcp:8:touch.500 Request processed in 410us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114959.332259:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16 00000100:00100000:3.0:1787114959.338816:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114959.338968:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602561152 00000100:00100000:0.0:1787114959.338980:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602561152 00000100:00100000:0.0:1787114959.339102:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17 00000100:00100000:0.0:1787114959.339159:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:0:x1873925602561152:12345-192.168.202.10@tcp:2:touch.500 00000100:00080000:3.0:1787114959.339524:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787114959.377891:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1787114959.377909:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6aef9ffe-3b7b-498c-9a5a-a012c6970297 00000100:00100000:0.0:1787114959.378327:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:0:x1873925602561152:12345-192.168.202.10@tcp:2:touch.500 Request processed in 39166us (39516us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787114959.378355:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17 00000100:00100000:0.0:1787114959.382065:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114959.382315:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602561408 00000100:00100000:1.0:1787114959.382325:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602561408 00000100:00100000:1.0:1787114959.382377:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 2 00000100:00100000:1.0:1787114959.382386:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c15aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+10:9668:x1873925602561408:12345-192.168.202.10@tcp:35:touch.500 00000100:00100000:1.0:1787114959.383031:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c15aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+11:9668:x1873925602561408:12345-192.168.202.10@tcp:35:touch.500 Request processed in 644us (974us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787114959.383039:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 2 00000100:00100000:3.0:1787114959.418598:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114959.418840:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602561536 00000100:00100000:0.0:1787114959.418850:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602561536 00000100:00100000:0.0:1787114959.418954:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 25 00000100:00100000:0.0:1787114959.418964:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+11:9669:x1873925602561536:12345-192.168.202.10@tcp:101:rm.0 00010000:00010000:0.0:1787114959.418987:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114959.419007:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c84cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1424 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.419076:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c84d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.419090:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c84d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.419102:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c84d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787114959.419200:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787114959.419203:0:7216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787114959.419241:0:7216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c84d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.419265:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c84cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1424 expref: 13 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.419283:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c84d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1424 expref: 12 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.419312:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8af0510d6500) 00010000:00010000:0.0:1787114959.419315:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787114959.419319:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030c00, rc 0) 00000100:00100000:0.0:1787114959.419370:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+12:9669:x1873925602561536:12345-192.168.202.10@tcp:101:rm.0 Request processed in 408us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114959.419377:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 25 00000100:00100000:3.0:1787114959.423784:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114959.423826:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602561792 00000100:00100000:0.0:1787114959.423838:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602561792 00000100:00100000:0.0:1787114959.423899:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 26 00000100:00100000:0.0:1787114959.423911:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+12:9669:x1873925602561792:12345-192.168.202.10@tcp:101:rm.0 00010000:00010000:0.0:1787114959.423933:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114959.423952:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c84d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d142b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787114959.424060:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787114959.424875:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c84d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d142b expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.424888:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af051ecbb00) 00010000:00010000:0.0:1787114959.424890:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787114959.424893:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c84d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d142b expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.424903:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040031000, rc 0) 00000100:00100000:0.0:1787114959.424954:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+13:9669:x1873925602561792:12345-192.168.202.10@tcp:101:rm.0 Request processed in 1046us (1186us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787114959.424971:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 26 00000100:00100000:2.0:1787114959.429961:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114959.430804:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602561920 00000100:00100000:0.0:1787114959.430815:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602561920 00000100:00100000:0.0:1787114959.430918:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 3 00000100:00100000:0.0:1787114959.430930:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+13:9669:x1873925602561920:12345-192.168.202.10@tcp:37:rm.0 00000100:00100000:0.0:1787114959.438545:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+13:9669:x1873925602561920:12345-192.168.202.10@tcp:37:rm.0 Request processed in 7599us (8576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114959.438563:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 3 00000100:00100000:3.0:1787114959.444487:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114959.445100:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602562176 00000100:00100000:1.0:1787114959.445313:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602562176 00000100:00100000:1.0:1787114959.445485:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4 00000100:00100000:1.0:1787114959.445497:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06634ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+13:9669:x1873925602562176:12345-192.168.202.10@tcp:35:rm.0 00000100:00100000:1.0:1787114959.445796:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06634ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+14:9669:x1873925602562176:12345-192.168.202.10@tcp:35:rm.0 Request processed in 302us (1318us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787114959.445804:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4 00000100:00100000:1.0:1787114959.452063:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114959.452142:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602562432 00000100:00100000:2.0:1787114959.452151:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602562432 00000100:00100000:2.0:1787114959.452200:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 27 00000100:00100000:2.0:1787114959.452207:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+14:9669:x1873925602562432:12345-192.168.202.10@tcp:101:rm.0 00010000:00010000:2.0:1787114959.452228:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114959.452250:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c84e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1432 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.452361:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c84ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.452372:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c84ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.453321:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c84ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787114959.453338:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787114959.453492:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c84e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1432 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.453511:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c84ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1432 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114959.453520:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8af0510d6500) 00010000:00010000:2.0:1787114959.453536:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787114959.453541:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3000, rc 0) 00000100:00100000:2.0:1787114959.453717:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+16:9669:x1873925602562432:12345-192.168.202.10@tcp:101:rm.0 Request processed in 1508us (1661us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787114959.453725:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 27 00000100:00100000:3.0:1787114959.460861:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114959.464512:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602562560 00000100:00100000:2.0:1787114959.464528:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602562560 00000100:00100000:2.0:1787114959.464602:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 28 00000100:00100000:2.0:1787114959.464678:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+16:9669:x1873925602562560:12345-192.168.202.10@tcp:41:rm.0 00000004:00000024:2.0:1787114959.464742:0:5785:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1787114959.464939:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+16:9669:x1873925602562560:12345-192.168.202.10@tcp:41:rm.0 Request processed in 326us (4086us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114959.464948:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 28 00000100:00100000:3.0:1787114959.473223:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114959.473311:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602562688 00000100:00100000:0.0:1787114959.473321:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602562688 00000100:00100000:0.0:1787114959.473392:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 29 00000100:00100000:0.0:1787114959.473414:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+16:9669:x1873925602562688:12345-192.168.202.10@tcp:101:rm.0 00010000:00010000:0.0:1787114959.473440:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114959.473463:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c84fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1439 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473534:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8503 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473549:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8503 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473561:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8503 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473575:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c850a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473602:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c850a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473609:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c850a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473776:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8511 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473786:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473794:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787114959.473822:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787114959.473826:0:7216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787114959.473845:0:7216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473857:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473866:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8503 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473873:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8503 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473880:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8503 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473896:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114959.473900:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8503 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473908:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8503 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473920:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8af0510d6500) 00010000:00010000:0.0:1787114959.473923:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114959.473928:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8503 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473935:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8503 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473949:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c850a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473956:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c850a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473961:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c850a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473967:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114959.473970:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c850a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473975:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c850a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.473993:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7eaa65ec (ffff8af051ecb700) 00010000:00010000:0.0:1787114959.473996:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114959.473999:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c850a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.474006:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c850a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.474037:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c84fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1439 expref: 18 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.474051:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8511 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1439 expref: 17 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.474059:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:0.0:1787114959.474061:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787114959.474064:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030a00, rc 0) 00000100:00100000:0.0:1787114959.474159:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+17:9669:x1873925602562688:12345-192.168.202.10@tcp:101:rm.0 Request processed in 756us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114959.474167:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 29 00000100:00100000:1.0:1787114959.486205:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114959.486284:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602562944 00000100:00100000:0.0:1787114959.486295:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602562944 00000100:00100000:0.0:1787114959.486361:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 30 00000100:00100000:0.0:1787114959.486370:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+17:9669:x1873925602562944:12345-192.168.202.10@tcp:36:rm.0 00010000:00010000:0.0:1787114959.486449:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787114959.486477:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8511 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1439 expref: 17 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.486520:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c84bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d141d expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.486530:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:0.0:1787114959.486545:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c84d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1424 expref: 15 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.486553:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8af0510d6500) 00010000:00010000:0.0:1787114959.486557:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787114959.486592:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8518 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.486606:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8518 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.486627:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8518 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.486645:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c851f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.486653:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c851f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.486660:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c851f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.486818:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8526 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.486836:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8526 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.486844:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8526 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787114959.487660:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787114959.487673:0:5786:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 288473565077ns, next at 289473562637ns, rc = 0 00010000:00010000:0.0:1787114959.487729:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c852d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.487740:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c852d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.487748:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c852d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.487755:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c852d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.487762:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c852d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.487769:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c852d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.487795:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787114959.487814:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8526 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.487820:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8526 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.487834:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8526 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.487841:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114959.487846:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8526 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.487854:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8526 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.487865:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8af051ecbf00) 00010000:00010000:0.0:1787114959.487868:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787114959.487872:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8526 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.487878:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8526 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.487896:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8518 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.487902:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8518 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.487908:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8518 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.487913:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040031000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114959.487916:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8518 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.487932:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8518 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.487941:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8af0510d6500) 00010000:00010000:0.0:1787114959.487943:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114959.487947:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8518 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.487953:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8518 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787114959.487964:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000032d4dc48 reply state 000000001668e523 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c851f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114959.487972:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787114959.488055:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+16:9669:x1873925602562944:12345-192.168.202.10@tcp:36:rm.0 Request processed in 1684us (1859us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787114959.488063:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 30 00010000:00010000:3.0:1787114959.488562:0:8290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787114959.488580:0:8290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c852d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114959.488587:0:8290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040031600 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:3.0:1787114959.488591:0:8290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c852d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114959.488597:0:8290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c852d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114959.488606:0:8290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8af051ecbf00) 00010000:00010000:3.0:1787114959.488608:0:8290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787114959.488619:0:8290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c852d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114959.488625:0:8290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c852d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114959.488641:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787114959.488642:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787114959.488644:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114959.490215:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c851f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.490229:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c851f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.490236:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c851f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.490242:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114959.490246:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c851f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.490269:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c851f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.490282:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7eaa65ec (ffff8af051ecb700) 00010000:00010000:0.0:1787114959.490285:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114959.490289:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c851f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.490296:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c851f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114959.491721:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114959.491998:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602563200 00000100:00100000:0.0:1787114959.492007:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602563200 00000100:00100000:0.0:1787114959.492088:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5 00000100:00100000:0.0:1787114959.492098:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+15:9669:x1873925602563200:12345-192.168.202.10@tcp:35:rm.0 00000100:00100000:0.0:1787114959.494283:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+16:9669:x1873925602563200:12345-192.168.202.10@tcp:35:rm.0 Request processed in 2174us (2556us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787114959.494298:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5 00000100:00100000:3.0:1787114959.497684:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114959.497823:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602563456 00000100:00100000:0.0:1787114959.497834:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602563456 00000100:00100000:0.0:1787114959.497895:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 31 00000100:00100000:0.0:1787114959.497905:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+16:9669:x1873925602563456:12345-192.168.202.10@tcp:36:rm.0 00010000:00010000:0.0:1787114959.497964:0:7216:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787114959.497993:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c84ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1432 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.498016:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c848c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d140f expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.498045:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8af0510d6500) 00010000:00010000:0.0:1787114959.498063:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c844d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1401 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.498073:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af051ecbb00) 00010000:00010000:0.0:1787114959.498080:0:7216:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787114959.498103:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c8534 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.498161:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c8534 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.498171:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c8534 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.498184:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365400/0x194cd781e88c853b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.498191:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365400/0x194cd781e88c853b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.498198:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365400/0x194cd781e88c853b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.498869:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c8542 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.498880:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c8542 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.498899:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c8542 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787114959.499583:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787114959.499604:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c8542 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.499613:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c8542 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.499620:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c8542 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.499627:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364800 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114959.499632:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c8542 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.499640:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c8542 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.499652:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:0.0:1787114959.499655:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787114959.499659:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c8542 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.499665:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c8542 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.499689:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c8534 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.499696:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c8534 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.499708:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c8534 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.499714:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364a00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114959.499717:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c8534 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.499724:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c8534 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.499731:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af051ecb500) 00010000:00010000:0.0:1787114959.499734:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114959.499737:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c8534 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.499742:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c8534 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787114959.499754:0:7216:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006e3f8dc7 reply state 000000003bee5999 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365400/0x194cd781e88c853b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114959.499763:0:7216:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787114959.499856:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+15:9669:x1873925602563456:12345-192.168.202.10@tcp:36:rm.0 Request processed in 1950us (2180us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787114959.499864:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 31 00010000:00010000:0.0:1787114959.510335:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365400/0x194cd781e88c853b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.510355:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365400/0x194cd781e88c853b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.510395:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365400/0x194cd781e88c853b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.510402:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052365400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114959.510414:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365400/0x194cd781e88c853b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.510421:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365400/0x194cd781e88c853b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.510440:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8af051ecbe00) 00010000:00010000:0.0:1787114959.510444:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114959.510449:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365400/0x194cd781e88c853b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114959.510456:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365400/0x194cd781e88c853b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114960.198391:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114961.223578:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114962.245453:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787114963.255421:0:11451:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1787114963.271874:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787114963.329137:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114963.329241:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114963.329276:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114963.329298:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114963.329331:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602563712 00000100:00100000:1.0:1787114963.329331:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602563840 00000100:00100000:1.0:1787114963.329341:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602563840 00000100:00100000:1.0:1787114963.329417:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 47 00000100:00100000:1.0:1787114963.329427:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2363:x1873925602563840:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114963.329500:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2363:x1873925602563840:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 75us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114963.329508:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 47 00000100:00100000:0.0:1787114963.329703:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602563584 00000100:00100000:0.0:1787114963.329708:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602563584 00000100:00100000:0.0:1787114963.329745:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 250 00000100:00100000:0.0:1787114963.329753:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2363:x1873925602563584:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787114963.329788:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2363:x1873925602563584:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 36us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114963.329795:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 250 00000100:00100000:0.0:1787114963.329822:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602563968 00000100:00100000:0.0:1787114963.329826:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602563968 00000100:00100000:0.0:1787114963.329877:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 112 00000100:00100000:0.0:1787114963.329884:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067b55fc-03d7-46d6-801a-48936d919d16+5:2363:x1873925602563968:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787114963.329897:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602563712 00000100:00100000:0.0:1787114963.329915:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067b55fc-03d7-46d6-801a-48936d919d16+5:2363:x1873925602563968:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 32us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114963.329921:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 112 00000100:00100000:3.0:1787114963.329926:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 113 00000100:00100000:3.0:1787114963.329933:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+14:2363:x1873925602563712:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787114963.329962:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+14:2363:x1873925602563712:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 29us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114963.329968:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 113 00000100:00080000:3.0:1787114963.329985:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787114963.329989:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787114963.850659:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787114963.850682:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624616320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787114963.851290:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114963.853164:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624616320 00000100:00100000:1.0:1787114963.853178:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624616320 00000100:00100000:1.0:1787114963.853243:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787114963.853254:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624616320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787114963.853294:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787114963.853380:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624616320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (2624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114963.853388:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1787114963.853410:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787114963.853445:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f6c2d80 x1873925624616320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114963.853466:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624616320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787114963.854623:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624616448:0@lo:400:kworker.0 00000100:00100000:0.0:1787114963.854684:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114963.854729:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787114963.854735:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624616576:0@lo:400:kworker.0 00000100:00100000:0.0:1787114963.854775:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114963.854805:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624616576 00000100:00100000:0.0:1787114963.854811:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624616576 00000100:00100000:0.0:1787114963.854962:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787114963.854970:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624616576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114963.855010:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624616576:12345-0@lo:400:kworker.0 Request processed in 41us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114963.855016:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787114963.855047:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624616576:0@lo:400:kworker.0 00000100:00100000:2.0:1787114963.855213:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624616448 00000100:00100000:2.0:1787114963.855216:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624616448 00000100:00100000:2.0:1787114963.855241:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787114963.855247:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624616448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114963.855277:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624616448:12345-0@lo:400:kworker.0 Request processed in 30us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114963.855283:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787114963.855346:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b6a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624616960:0@lo:400:kworker.0 00000100:00100000:0.0:1787114963.855382:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114963.855409:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624616448:0@lo:400:kworker.0 00000100:00100000:1.0:1787114963.855948:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b68dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624616832:0@lo:400:kworker.0 00000100:00100000:1.0:1787114963.855979:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114963.856008:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787114963.856015:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624616704:0@lo:400:kworker.0 00000100:00100000:1.0:1787114963.856035:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114963.856200:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624616960 00000100:00100000:2.0:1787114963.856206:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624616960 00000100:00100000:2.0:1787114963.856250:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787114963.856257:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c15a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624616960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114963.856301:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c15a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624616960:12345-0@lo:400:kworker.0 Request processed in 45us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114963.856308:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1787114963.856338:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07b6a7100 x1873925624616960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114963.856350:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b6a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624616960:0@lo:400:kworker.0 00000100:00100000:0.0:1787114963.856473:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624616832 00000100:00100000:0.0:1787114963.856478:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624616832 00000100:00100000:0.0:1787114963.856499:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624616704 00000100:00100000:0.0:1787114963.856502:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624616704 00000100:00100000:0.0:1787114963.856533:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787114963.856919:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624616832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114963.856977:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624616832:12345-0@lo:400:kworker.0 Request processed in 438us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114963.856983:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787114963.856997:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787114963.857003:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624616704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114963.857029:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624616704:12345-0@lo:400:kworker.0 Request processed in 27us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114963.857035:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:1.0:1787114963.857179:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787114963.857189:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787114963.857226:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624616704:0@lo:400:kworker.0 00000100:00100000:1.0:1787114963.857235:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b68dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624616832:0@lo:400:kworker.0 00010000:00010000:3.0:1787114964.297256:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787114964.357893:0:7774:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 293343783045ns, next at 294343780344ns, rc = 0 00000100:00100000:2.0:1787114964.357915:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787114964.357936:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b6a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624617088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787114964.358010:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114964.358167:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624617088 00000100:00100000:1.0:1787114964.358175:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624617088 00000100:00100000:1.0:1787114964.358223:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787114964.358232:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624617088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787114964.358269:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787114964.358321:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624617088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114964.358328:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1787114964.358384:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07b6a7100 x1873925624617088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114964.358403:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b6a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624617088:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1787114964.368420:0:11500:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdbb4854b0 20000000:00000080:0.0:1787114964.368441:0:11500:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8af07ba10400 uarg=0000000000000000 20000000:01000000:0.0:1787114964.368478:0:11500:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787114964.368485:0:11500:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787114964.368489:0:11500:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1787114964.372694:0:11501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787114964.374280:0:11500:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1787114964.376980:0:11500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1787114964.377039:0:11500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1787114964.377095:0:11500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1787114964.377146:0:11500:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787114964.377170:0:11500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8af07b6a0a00/0x194cd781e88c8549 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.377193:0:11500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af052364c00/0x194cd781e88c83eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13ec expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.377201:0:11500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af0429ca600/0x194cd781e88c83f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13f3 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.377219:0:11500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af052364400/0x194cd781e88c8400 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c83f9 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.377226:0:11500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af042cb3a00/0x194cd781e88c840e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8407 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.377232:0:11500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af0429cbe00/0x194cd781e88c841c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8415 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.377239:0:11500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8af07b6a0a00/0x194cd781e88c8549 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.377288:0:11500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af0429cbe00/0x194cd781e88c841c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c8415 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.377306:0:11500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af0429cbe00/0x194cd781e88c841c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c8415 expref: 18 pid: 5778 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114964.377325:0:11500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b68dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11500:1873925624617216:0@lo:104: 00000100:00100000:1.0:1787114964.382597:0:11500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787114964.383609:0:11500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af042cb3a00/0x194cd781e88c840e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c8407 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.383628:0:11500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af042cb3a00/0x194cd781e88c840e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c8407 expref: 18 pid: 5779 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114964.383647:0:11500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11500:1873925624617344:0@lo:104: 00000100:00100000:1.0:1787114964.383693:0:11500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787114964.389157:0:11500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af052364400/0x194cd781e88c8400 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c83f9 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.389185:0:11500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8af052364400/0x194cd781e88c8400 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c83f9 expref: 18 pid: 5780 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114964.389202:0:11500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11500:1873925624617472:0@lo:104: 00000100:00100000:1.0:1787114964.389262:0:11500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:3.0:1787114964.390451:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1787114964.390470:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:3.0:1787114964.390497:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:0.0:1787114964.390674:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624617216 00000100:00100000:0.0:1787114964.390683:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624617216 00000100:00100000:0.0:1787114964.390723:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624617344 00000100:00100000:0.0:1787114964.390726:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624617344 00000100:00100000:0.0:1787114964.390741:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787114964.390749:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+4:11500:x1873925624617216:12345-0@lo:104: 00010000:00010000:0.0:1787114964.390764:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1c00/0x194cd781e88c8415 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c841c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.390833:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787114964.390839:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+4:11500:x1873925624617216:12345-0@lo:104: Request processed in 91us (8251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114964.390846:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787114964.390872:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787114964.390877:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:11500:x1873925624617344:12345-0@lo:104: 00010000:00010000:0.0:1787114964.390885:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c8407 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c840e expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.390919:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787114964.390924:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:11500:x1873925624617344:12345-0@lo:104: Request processed in 47us (7231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114964.390929:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1787114964.390953:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787114964.390959:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1c00/0x194cd781e88c8415 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c841c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.390966:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1c00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:0.0:1787114964.390971:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1c00/0x194cd781e88c8415 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c841c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.390980:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1c00/0x194cd781e88c8415 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c841c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787114964.390987:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1c00/0x194cd781e88c8415 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c841c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114964.390994:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787114964.391023:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1c00/0x194cd781e88c8415 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c841c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.391029:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787114964.391036:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1c00/0x194cd781e88c8415 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c841c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.391052:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1c00/0x194cd781e88c8415 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c841c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.391064:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787114964.391067:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c8407 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c840e expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.391073:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1600 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:0.0:1787114964.391076:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c8407 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c840e expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.391082:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c8407 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c840e expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787114964.391089:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c8407 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c840e expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114964.391094:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787114964.391127:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c8407 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c840e expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.391134:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787114964.391149:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c8407 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c840e expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.391155:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c8407 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c840e expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.391162:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114964.391169:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114964.391171:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114964.391184:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624617856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787114964.391220:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114964.391268:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624617856 00000100:00100000:0.0:1787114964.391272:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624617856 00010000:00010000:0.0:1787114964.391290:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af042cb3a00/0x194cd781e88c840e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8407 expref: 19 pid: 5779 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114964.391314:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787114964.391319:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624617856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787114964.391329:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787114964.391334:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af042cb3a00/0x194cd781e88c840e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8407 expref: 19 pid: 5779 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.391343:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af042cb3a00/0x194cd781e88c840e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c8407 expref: 19 pid: 5779 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.391369:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787114964.391396:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624617856:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114964.391402:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787114964.391439:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624617856:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787114964.391517:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114964.391809:0:5768:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787114964.391821:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624617472 00000100:00100000:0.0:1787114964.391824:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624617472 00000100:00100000:0.0:1787114964.391842:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787114964.391848:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:11500:x1873925624617472:12345-0@lo:104: 00010000:00010000:0.0:1787114964.391865:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0400/0x194cd781e88c83f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8400 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.391902:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787114964.391907:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+3:11500:x1873925624617472:12345-0@lo:104: Request processed in 60us (2646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114964.391913:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1787114964.391954:0:8290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787114964.391959:0:8290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0400/0x194cd781e88c83f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c8400 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.391966:0:8290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0400 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:0.0:1787114964.391969:0:8290:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0400/0x194cd781e88c83f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c8400 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.391975:0:8290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0400/0x194cd781e88c83f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c8400 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787114964.391981:0:8290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0400/0x194cd781e88c83f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c8400 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114964.391986:0:8290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787114964.392001:0:8290:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0400/0x194cd781e88c83f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8400 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.392007:0:8290:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787114964.392018:0:8290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0400/0x194cd781e88c83f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8400 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.392025:0:8290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0400/0x194cd781e88c83f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c8400 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.392044:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114964.392045:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114964.392047:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114964.392057:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624617984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787114964.392083:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114964.392137:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624617984 00000100:00100000:0.0:1787114964.392141:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624617984 00010000:00010000:0.0:1787114964.392154:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af052364400/0x194cd781e88c8400 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c83f9 expref: 19 pid: 5780 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114964.392173:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787114964.392178:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c159f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3307:x1873925624617984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787114964.392185:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787114964.392189:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af052364400/0x194cd781e88c8400 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c83f9 expref: 19 pid: 5780 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.392197:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af052364400/0x194cd781e88c8400 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c83f9 expref: 19 pid: 5780 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.392210:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787114964.392233:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c159f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3307:x1873925624617984:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114964.392239:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787114964.392264:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624617984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787114964.392377:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624617600:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787114964.392410:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114964.392430:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787114964.392435:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624617728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787114964.392457:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114964.392488:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624617600 00000100:00100000:1.0:1787114964.392491:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624617600 00000100:00100000:1.0:1787114964.392520:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787114964.392538:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624617600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787114964.392562:0:6578:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1787114964.392597:0:6578:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8535d0, atime: 0x6a8535d0, ctime: 0x6a8535d0, blocks: 0x1 00010000:00010000:1.0:1787114964.392604:0:6578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012be3d87/0x194cd781e88c8550 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.392619:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=293s v=(0 0) 00010000:00010000:1.0:1787114964.392623:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787114964.392630:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012be3d87/0x194cd781e88c8550 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.392648:0:6578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012be3d87/0x194cd781e88c8550 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.392668:0:6578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012be3d87/0x194cd781e88c8550 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.392676:0:6578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012be3d87/0x194cd781e88c8550 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.392691:0:6578:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787114964.393269:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1873925624617600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 742us (856us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787114964.393278:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787114964.393305:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624617728 00000100:00100000:1.0:1787114964.393309:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624617728 00010000:00010000:1.0:1787114964.393327:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af0429cbe00/0x194cd781e88c841c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8415 expref: 19 pid: 5778 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114964.393350:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787114964.393357:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624617728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787114964.393380:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787114964.393385:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af0429cbe00/0x194cd781e88c841c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c8415 expref: 19 pid: 5778 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.393395:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af0429cbe00/0x194cd781e88c841c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c8415 expref: 19 pid: 5778 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.393408:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787114964.393431:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624617728:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114964.393447:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1787114964.393494:0:8291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787114964.393501:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012be3d87/0x194cd781e88c8550 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.393510:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1a00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:1.0:1787114964.393514:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012be3d87/0x194cd781e88c8550 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.393524:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012be3d87/0x194cd781e88c8550 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.393538:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012be3d87/0x194cd781e88c8550 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.393546:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012be3d87/0x194cd781e88c8550 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.393562:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114964.393564:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114964.393566:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114964.393596:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624617728:0@lo:103:ldlm_bl.0 00000004:00080000:1.0:1787114964.393612:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8af06eb72300/2, rc 0, transno 4294967300 00000100:00100000:1.0:1787114964.393617:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624617600:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787114964.393669:0:11500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af0429ca600/0x194cd781e88c83f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13f3 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.393686:0:11500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af0429ca600/0x194cd781e88c83f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13f3 expref: 12 pid: 5779 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114964.393699:0:11500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11500:1873925624618112:192.168.202.10@tcp:104: 00010000:00010000:1.0:1787114964.393761:0:11500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af052364c00/0x194cd781e88c83eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13ec expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114964.393769:0:11500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af052364c00/0x194cd781e88c83eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13ec expref: 12 pid: 5779 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114964.393777:0:11500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11500:1873925624618240:192.168.202.10@tcp:104: 00000100:00100000:1.0:1787114964.393798:0:11500:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0451da540 going to sleep for 11 seconds 00010000:00010000:1.0:1787114964.393811:0:11500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af0429cbe00/0x194cd781e88c841c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c8415 expref: 18 pid: 5778 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114964.393820:0:11500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b68dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11500:1873925624617216:0@lo:104: 00010000:00010000:1.0:1787114964.393830:0:11500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af042cb3a00/0x194cd781e88c840e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c8407 expref: 17 pid: 5779 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114964.393837:0:11500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11500:1873925624617344:0@lo:104: 00010000:00010000:1.0:1787114964.393847:0:11500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af052364400/0x194cd781e88c8400 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c83f9 expref: 16 pid: 5780 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114964.393855:0:11500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11500:1873925624617472:0@lo:104: 00000100:00100000:3.0:1787114964.397586:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114964.397674:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114964.397884:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602564096 00000100:00100000:2.0:1787114964.397895:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602564096 00010000:00010000:2.0:1787114964.397931:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af0429ca600/0x194cd781e88c83f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13f3 expref: 13 pid: 5779 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114964.397968:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602564224 00000100:00100000:2.0:1787114964.397971:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602564224 00010000:00010000:2.0:1787114964.397981:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af052364c00/0x194cd781e88c83eb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13ec expref: 14 pid: 5779 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114964.397996:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 33 00000100:00100000:2.0:1787114964.398005:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+14:2363:x1873925602564096:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787114964.398021:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787114964.398026:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af0429ca600/0x194cd781e88c83f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13f3 expref: 14 pid: 5779 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114964.398050:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af0429ca600/0x194cd781e88c83f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13f3 expref: 14 pid: 5779 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114964.398073:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787114964.398152:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+14:2363:x1873925602564096:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 147us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114964.398160:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 33 00000100:00100000:2.0:1787114964.398177:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 34 00000100:00100000:2.0:1787114964.398184:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07398bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2363:x1873925602564224:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787114964.398192:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787114964.398196:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af052364c00/0x194cd781e88c83eb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13ec expref: 13 pid: 5779 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114964.398205:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af052364c00/0x194cd781e88c83eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13ec expref: 13 pid: 5779 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114964.398217:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8af07b6a0a00/0x194cd781e88c8549 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114964.398227:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af07b6a0a00/0x194cd781e88c8549 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114964.398241:0:5772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af07b6a0a00/0x194cd781e88c8549 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114964.398249:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af07b6a0a00/0x194cd781e88c8549 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114964.398256:0:5772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8af07b6a0a00/0x194cd781e88c8549 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114964.398269:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8af07b6a0a00/0x194cd781e88c8549 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114964.398276:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0a00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787114964.398280:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8af07b6a0a00/0x194cd781e88c8549 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114964.398289:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8af07b6a0a00/0x194cd781e88c8549 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114964.398299:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8af07b6a0a00/0x194cd781e88c8549 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114964.398309:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787114964.398329:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07398bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2363:x1873925602564224:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 146us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114964.398336:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 34 00010000:00010000:0.0:1787114964.401708:0:11500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af0429ca600/0x194cd781e88c83f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13f3 expref: 12 pid: 5779 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114964.401752:0:11500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11500:1873925624618112:192.168.202.10@tcp:104: 00010000:00010000:0.0:1787114964.401768:0:11500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af052364c00/0x194cd781e88c83eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13ec expref: 11 pid: 5779 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114964.401777:0:11500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11500:1873925624618240:192.168.202.10@tcp:104: 00010000:00010000:0.0:1787114964.401811:0:11500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8af07b6a0a00/0x194cd781e88c8549 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.401821:0:11500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8af07b6a0a00/0x194cd781e88c8549 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.401828:0:11500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8af07b6a0a00/0x194cd781e88c8549 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114964.401833:0:11500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af07b6a0a00/0x194cd781e88c8549 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114965.324627:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114965.561904:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114965.562010:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602564352 00000100:00100000:3.0:1787114965.562021:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602564352 00000100:00100000:3.0:1787114965.562081:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 252 00000100:00100000:3.0:1787114965.562092:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+11:5579:x1873925602564352:12345-192.168.202.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787114965.562146:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787114965.562167:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af0429cb200/0x194cd781e88c8557 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1440 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114965.562196:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af0429cb200/0x194cd781e88c8557 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1440 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114965.562208:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af0429cb200/0x194cd781e88c8557 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1440 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114965.562218:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429cb200, rc 0) 00000100:00100000:3.0:1787114965.562266:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:5579:x1873925602564352:12345-192.168.202.10@tcp:101:ll_cfg_requeue.0 Request processed in 177us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114965.562273:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 252 00000100:00100000:2.0:1787114965.567709:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114965.567819:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602564480 00000100:00100000:0.0:1787114965.567829:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602564480 00000100:00100000:0.0:1787114965.567880:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 253 00000100:00100000:0.0:1787114965.567889:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:5579:x1873925602564480:12345-192.168.202.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787114965.568212:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:5579:x1873925602564480:12345-192.168.202.10@tcp:501:ll_cfg_requeue.0 Request processed in 322us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114965.568221:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 253 00000100:00100000:0.0:1787114965.570597:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114965.570660:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602564608 00000100:00100000:2.0:1787114965.570670:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602564608 00000100:00100000:2.0:1787114965.570769:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 254 00000100:00100000:2.0:1787114965.570780:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:5579:x1873925602564608:12345-192.168.202.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787114965.571016:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:5579:x1873925602564608:12345-192.168.202.10@tcp:503:ll_cfg_requeue.0 Request processed in 237us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114965.571024:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 254 00000100:00100000:1.0:1787114965.577944:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114965.578073:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602564736 00000100:00100000:3.0:1787114965.578084:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602564736 00000100:00100000:3.0:1787114965.578166:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 255 00000100:00100000:3.0:1787114965.578176:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:9939:x1873925602564736:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787114965.578608:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:9939:x1873925602564736:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 431us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114965.578616:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 255 00000100:00100000:1.0:1787114965.588806:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114965.588928:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602564864 00000100:00100000:2.0:1787114965.588938:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602564864 00000100:00100000:2.0:1787114965.589006:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 256 00000100:00100000:2.0:1787114965.589016:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:9939:x1873925602564864:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787114965.591925:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:9939:x1873925602564864:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 2901us (3118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114965.591939:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 256 00000100:00100000:0.0:1787114965.603018:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114965.607635:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602564992 00000100:00100000:3.0:1787114965.607664:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602564992 00000100:00100000:3.0:1787114965.607780:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 257 00000100:00100000:3.0:1787114965.607790:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:5579:x1873925602564992:12345-192.168.202.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787114965.607806:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787114965.607823:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af0429ca200/0x194cd781e88c855e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1447 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114965.607854:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af0429ca200/0x194cd781e88c855e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1447 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114965.607867:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af0429ca200/0x194cd781e88c855e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1447 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114965.607877:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429ca200, rc 0) 00000100:00100000:3.0:1787114965.607949:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:5579:x1873925602564992:12345-192.168.202.10@tcp:101:ll_cfg_requeue.0 Request processed in 160us (4940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114965.607957:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 257 00000100:00100000:1.0:1787114965.615747:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114965.621225:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602565120 00000100:00100000:2.0:1787114965.621240:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602565120 00000100:00100000:2.0:1787114965.621447:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 258 00000100:00100000:2.0:1787114965.621459:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:5579:x1873925602565120:12345-192.168.202.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787114965.621948:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:5579:x1873925602565120:12345-192.168.202.10@tcp:501:ll_cfg_requeue.0 Request processed in 489us (6208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114965.621957:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 258 00000100:00100000:1.0:1787114965.635762:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114965.636103:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602565248 00000100:00100000:3.0:1787114965.636158:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602565248 00000100:00100000:3.0:1787114965.636222:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 259 00000100:00100000:3.0:1787114965.636233:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:5579:x1873925602565248:12345-192.168.202.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787114965.638482:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:5579:x1873925602565248:12345-192.168.202.10@tcp:503:ll_cfg_requeue.0 Request processed in 2241us (2720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114965.638503:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 259 10000000:01000000:3.0:1787114965.639232:0:5782:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787114965.639237:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af07b581000 from 7 10000000:01000000:3.0:1787114965.639241:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787114965.639367:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8565 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114965.639392:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8565 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114965.639405:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8565 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114965.639431:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07398ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624618368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787114965.639494:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114965.639663:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045bd03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787114965.639733:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624618368 00000100:00100000:0.0:1787114965.639742:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624618368 00000100:00100000:0.0:1787114965.639792:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787114965.639801:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:5782:x1873925624618368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787114965.639815:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114965.639828:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af052364a00/0x194cd781e88c856c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8565 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114965.639853:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af052364a00/0x194cd781e88c856c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8565 expref: 17 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114965.639863:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af052364a00/0x194cd781e88c856c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8565 expref: 17 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114965.639873:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052364a00, rc 0) 00000100:00100000:0.0:1787114965.639919:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624618368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114965.639926:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787114965.640040:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07398ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624618368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787114965.640054:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8565 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c856c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114965.640063:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8565 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c856c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114965.640154:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07398ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624618496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787114965.640182:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114965.640209:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045bd03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787114965.640368:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624618496 00000100:00100000:2.0:1787114965.640373:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624618496 00000100:00100000:2.0:1787114965.640396:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787114965.640402:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624618496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787114965.640669:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624618496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114965.640677:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787114965.641239:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07398ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624618496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787114965.641446:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07398ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624618624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787114965.641494:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114965.641704:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045bd03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787114965.641768:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624618624 00000100:00100000:2.0:1787114965.641774:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624618624 00000100:00100000:2.0:1787114965.641820:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787114965.641829:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624618624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787114965.641998:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624618624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114965.642019:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787114965.642217:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07398ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624618624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787114965.642721:0:11514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:11514:1873925624618752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787114965.642756:0:11514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114965.642782:0:11514:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0451dac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787114965.642808:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624618752 00000100:00100000:0.0:1787114965.642814:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624618752 00000100:00100000:0.0:1787114965.642850:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787114965.642858:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:11514:x1873925624618752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787114965.643007:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:11514:x1873925624618752:12345-0@lo:502:llog_process_th.0 Request processed in 150us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114965.643015:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787114965.643030:0:11514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:11514:1873925624618752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787114965.643051:0:11514:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787114965.643058:0:11514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787114965.643060:0:11514:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787114965.643064:0:11514:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8af07b581000 00000020:00000080:1.0:1787114965.643066:0:11514:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787114965.643156:0:11514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:11514:1873925624618880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787114965.643185:0:11514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114965.643214:0:11514:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0451dac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787114965.643377:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624618880 00000100:00100000:2.0:1787114965.643382:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624618880 00000100:00100000:2.0:1787114965.643419:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787114965.643426:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:11514:x1873925624618880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787114965.643565:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:11514:x1873925624618880:12345-0@lo:502:llog_process_th.0 Request processed in 139us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114965.643572:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787114965.644941:0:11514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:11514:1873925624618880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787114965.644997:0:11514:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787114965.645005:0:11514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787114965.645008:0:11514:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787114965.645012:0:11514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787114965.645421:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787114965.645446:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787114965.645457:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8565 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c856c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114965.645475:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8565 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c856c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787114965.645485:0:5782:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787114965.645488:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af06f41d000 from 7 10000000:01000000:2.0:1787114965.645497:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787114965.645544:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af042cb3200/0x194cd781e88c8573 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114965.645552:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af042cb3200/0x194cd781e88c8573 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114965.645566:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af042cb3200/0x194cd781e88c8573 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114965.645594:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b6a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624619008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787114965.645662:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114965.646021:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af074a0df00 going to sleep for 11 seconds 00000100:00100000:3.0:1787114965.651238:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624619008 00000100:00100000:3.0:1787114965.651255:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624619008 00000100:00100000:2.0:1787114965.655657:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787114965.655671:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:5782:x1873925624619008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787114965.655690:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114965.655709:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af042cb3800/0x194cd781e88c857a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8573 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114965.655736:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af042cb3800/0x194cd781e88c857a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8573 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114965.655747:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af042cb3800/0x194cd781e88c857a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8573 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114965.655756:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3800, rc 0) 00000100:00100000:2.0:1787114965.655843:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624619008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (10181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114965.655849:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787114965.657272:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b6a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624619008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787114965.657411:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af042cb3200/0x194cd781e88c8573 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c857a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114965.657433:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af042cb3200/0x194cd781e88c8573 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c857a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114965.657522:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c15aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624619136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787114965.657574:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114965.657617:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309de40 going to sleep for 11 seconds 00000100:00100000:2.0:1787114965.657627:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624619136 00000100:00100000:2.0:1787114965.657633:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624619136 00000100:00100000:2.0:1787114965.657676:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787114965.657684:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624619136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787114965.657925:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624619136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114965.657933:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787114965.658429:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c15aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624619136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787114965.658463:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c15aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624619264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787114965.658512:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114965.658539:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309de40 going to sleep for 11 seconds 00000100:00100000:3.0:1787114965.658573:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624619264 00000100:00100000:3.0:1787114965.658577:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624619264 00000100:00100000:3.0:1787114965.658611:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787114965.658618:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624619264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787114965.658770:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624619264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114965.658777:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787114965.659236:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c15aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624619264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787114965.659904:0:11517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07398ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:11517:1873925624619392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787114965.660067:0:11517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114965.660122:0:11517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045bd0780 going to sleep for 11 seconds 00000100:00100000:2.0:1787114965.660259:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114965.660362:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624619392 00000100:00100000:3.0:1787114965.660368:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624619392 00000100:00100000:3.0:1787114965.660406:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602565376 00000100:00100000:3.0:1787114965.660409:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602565376 00000100:00100000:3.0:1787114965.660426:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787114965.660433:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051311050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:11517:x1873925624619392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787114965.660528:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 269 00000100:00100000:2.0:1787114965.660545:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051312c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:9942:x1873925602565376:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787114965.660741:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051312c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:9942:x1873925602565376:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 198us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114965.660748:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 269 00000100:00100000:3.0:1787114965.660996:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051311050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:11517:x1873925624619392:12345-0@lo:502:llog_process_th.0 Request processed in 563us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114965.661003:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787114965.661082:0:11517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07398ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:11517:1873925624619392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787114965.661141:0:11517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787114965.661151:0:11517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787114965.661154:0:11517:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787114965.661161:0:11517:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8af06f41d000 00000020:00000080:2.0:1787114965.661164:0:11517:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787114965.661236:0:11517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b6a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:11517:1873925624619520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787114965.661274:0:11517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114965.661295:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624619520 00000100:00100000:2.0:1787114965.661299:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624619520 00000100:00100000:2.0:1787114965.661323:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787114965.661329:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051311850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:11517:x1873925624619520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787114965.661529:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051311850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:11517:x1873925624619520:12345-0@lo:502:llog_process_th.0 Request processed in 198us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114965.661535:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787114965.661572:0:11517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045a37f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787114965.661585:0:11517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b6a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:11517:1873925624619520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787114965.661603:0:11517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787114965.661607:0:11517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787114965.661609:0:11517:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787114965.661613:0:11517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787114965.662719:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787114965.662743:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787114965.662754:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af042cb3200/0x194cd781e88c8573 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c857a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114965.662767:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af042cb3200/0x194cd781e88c8573 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c857a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787114965.662778:0:5782:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787114965.662781:0:5782:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af05032f000 from 7 10000000:01000000:0.0:1787114965.662783:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787114965.662813:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8581 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114965.662821:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8581 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114965.662839:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8581 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114965.662860:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c15aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624619648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787114965.662905:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114965.662945:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af074a0df00 going to sleep for 11 seconds 00000100:00100000:2.0:1787114965.662996:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624619648 00000100:00100000:2.0:1787114965.663007:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624619648 00000100:00100000:2.0:1787114965.663045:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787114965.663053:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051313850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:5782:x1873925624619648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787114965.663065:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114965.663078:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af042cb2c00/0x194cd781e88c8588 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c8581 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114965.663103:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af042cb2c00/0x194cd781e88c8588 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c8581 expref: 19 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114965.663146:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af042cb2c00/0x194cd781e88c8588 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c8581 expref: 19 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114965.663155:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2c00, rc 0) 00000100:00100000:2.0:1787114965.663187:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051313850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:5782:x1873925624619648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114965.663193:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787114965.663269:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c15aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624619648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787114965.663282:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8581 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8588 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114965.663290:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8581 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8588 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114965.663334:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c15aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624619776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787114965.663394:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114965.663424:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af074a0df00 going to sleep for 11 seconds 00000100:00100000:2.0:1787114965.663524:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624619776 00000100:00100000:2.0:1787114965.663528:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624619776 00000100:00100000:2.0:1787114965.663551:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787114965.663558:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051310850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:5782:x1873925624619776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787114965.663778:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051310850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:5782:x1873925624619776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114965.663785:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787114965.663848:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c15aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624619776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787114965.663875:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c15aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624619904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787114965.663908:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114965.663929:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af074a0df00 going to sleep for 11 seconds 00000100:00100000:2.0:1787114965.663968:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624619904 00000100:00100000:2.0:1787114965.663973:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624619904 00000100:00100000:2.0:1787114965.664000:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787114965.664007:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051310450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:5782:x1873925624619904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787114965.664167:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051310450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:5782:x1873925624619904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114965.664174:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787114965.664368:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c15aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6bfcc0b7-8035-40e1-91c8-e687d170788c:5782:1873925624619904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787114965.664746:0:11518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073989880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:11518:1873925624620032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787114965.664783:0:11518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114965.664819:0:11518:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045bd0000 going to sleep for 11 seconds 00000100:00100000:2.0:1787114965.664859:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624620032 00000100:00100000:2.0:1787114965.664864:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624620032 00000100:00100000:2.0:1787114965.664893:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787114965.664900:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051313450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:11518:x1873925624620032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787114965.665040:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051313450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:11518:x1873925624620032:12345-0@lo:502:llog_process_th.0 Request processed in 140us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114965.665047:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787114965.665066:0:11518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073989880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:11518:1873925624620032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787114965.665088:0:11518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787114965.665098:0:11518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787114965.665100:0:11518:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787114965.665133:0:11518:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8af05032f000 00000020:00000080:1.0:1787114965.665136:0:11518:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787114965.665705:0:11518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:11518:1873925624620160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787114965.665744:0:11518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114965.665774:0:11518:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0451da0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787114965.665842:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624620160 00000100:00100000:0.0:1787114965.665847:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624620160 00000100:00100000:0.0:1787114965.665881:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787114965.665889:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051311450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:11518:x1873925624620160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787114965.666039:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051311450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:11518:x1873925624620160:12345-0@lo:502:llog_process_th.0 Request processed in 150us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114965.666046:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1787114965.666483:0:11518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6bfcc0b7-8035-40e1-91c8-e687d170788c:11518:1873925624620160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787114965.666573:0:11518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787114965.666580:0:11518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787114965.666585:0:11518:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787114965.666589:0:11518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787114965.668389:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787114965.668423:0:5782:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787114965.668436:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8581 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8588 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114965.668568:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8581 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8588 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114965.669561:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114965.670738:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602565504 00000100:00100000:0.0:1787114965.670752:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602565504 00000100:00100000:0.0:1787114965.670799:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 276 00000100:00100000:0.0:1787114965.670809:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051312450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:9942:x1873925602565504:12345-192.168.202.10@tcp:502:llog_process_th.0 00000040:00080000:2.0:1787114965.670939:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787114965.671037:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051312450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:9942:x1873925602565504:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 228us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114965.671046:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 276 00010000:00010000:3.0:1787114966.341274:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787114966.726003:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787114967.365371:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114968.389916:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114968.441925:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114968.441970:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114968.442004:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114968.442035:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602565888 00000100:00100000:2.0:1787114968.442044:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602565888 00000100:00100000:2.0:1787114968.442095:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 49 00000100:00100000:2.0:1787114968.442104:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2362:x1873925602565888:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787114968.442193:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2362:x1873925602565888:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 90us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114968.442200:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 49 00000100:00080000:2.0:1787114968.442217:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787114968.442454:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602565760 00000100:00100000:0.0:1787114968.442458:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602565760 00000100:00100000:0.0:1787114968.442505:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 117 00000100:00100000:0.0:1787114968.442511:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2361:x1873925602565760:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787114968.442541:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2361:x1873925602565760:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 30us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114968.442547:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 117 00000100:00080000:2.0:1787114968.442755:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787114968.443011:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114968.443208:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602566016 00000100:00100000:0.0:1787114968.443213:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602566016 00000100:00100000:0.0:1787114968.443260:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 118 00000100:00100000:0.0:1787114968.443267:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067b55fc-03d7-46d6-801a-48936d919d16+5:2361:x1873925602566016:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787114968.443303:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067b55fc-03d7-46d6-801a-48936d919d16+5:2361:x1873925602566016:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 36us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114968.443309:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 118 00000100:00080000:3.0:1787114968.443620:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787114968.444458:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602565632 00000100:00100000:1.0:1787114968.444467:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602565632 00000100:00100000:1.0:1787114968.444524:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 277 00000100:00100000:1.0:1787114968.444533:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051312050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602565632:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114968.444581:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051312050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602565632:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 49us (2610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114968.444588:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 277 00000100:00100000:0.0:1787114968.965817:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624620416:0@lo:400:kworker.0 00000100:00100000:0.0:1787114968.965904:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114968.965984:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07398ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624620928:0@lo:400:kworker.0 00000100:00100000:0.0:1787114968.966013:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114968.966049:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787114968.966055:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07398aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624620288:0@lo:400:kworker.0 00000100:00100000:0.0:1787114968.966088:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114968.966138:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624620800:0@lo:400:kworker.0 00000100:00100000:0.0:1787114968.966163:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114968.966191:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624620672:0@lo:400:kworker.0 00000100:00100000:0.0:1787114968.966216:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114968.966235:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787114968.966253:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624620544:0@lo:400:kworker.0 00000100:00100000:0.0:1787114968.966277:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114968.966305:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624620928 00000100:00100000:3.0:1787114968.966865:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624620416 00000100:00100000:3.0:1787114968.966872:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624620416 00000100:00100000:3.0:1787114968.966913:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624620800 00000100:00100000:3.0:1787114968.966916:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624620800 00000100:00100000:3.0:1787114968.966933:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624620544 00000100:00100000:3.0:1787114968.966935:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624620544 00000100:00100000:3.0:1787114968.966949:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787114968.966957:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c15aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624620416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114968.967016:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c15aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624620416:12345-0@lo:400:kworker.0 Request processed in 59us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114968.967022:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787114968.967037:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787114968.967042:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624620800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114968.967065:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624620800:12345-0@lo:400:kworker.0 Request processed in 24us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114968.967070:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787114968.967080:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787114968.967085:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624620544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114968.967130:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624620544:12345-0@lo:400:kworker.0 Request processed in 45us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114968.967136:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1787114968.967152:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787114968.967184:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624620544:0@lo:400:kworker.0 00000100:00100000:3.0:1787114968.967231:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624620800:0@lo:400:kworker.0 00000100:00100000:3.0:1787114968.967240:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624620416:0@lo:400:kworker.0 00000100:00100000:3.0:1787114968.967302:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624620288 00000100:00100000:3.0:1787114968.967306:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624620288 00000100:00100000:0.0:1787114968.967561:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624620928 00000100:00100000:0.0:1787114968.967595:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624620672 00000100:00100000:0.0:1787114968.967598:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624620672 00000100:00100000:0.0:1787114968.967610:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787114968.967706:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787114968.967712:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051310050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624620288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114968.967752:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051310050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624620288:12345-0@lo:400:kworker.0 Request processed in 40us (1664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114968.967759:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787114968.967865:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1873925624620928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114968.967899:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1873925624620928:12345-0@lo:400:kworker.0 Request processed in 36us (1885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114968.967905:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787114968.967915:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787114968.967920:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624620672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114968.967947:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624620672:12345-0@lo:400:kworker.0 Request processed in 27us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114968.967951:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1787114968.967968:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787114968.967971:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787114968.967989:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af073988a80 x1873925624620672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114968.967999:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624620672:0@lo:400:kworker.0 00000100:00100000:1.0:1787114968.968197:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624621056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787114968.968226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114968.968267:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624621056 00000100:00100000:1.0:1787114968.968270:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624621056 00000100:00100000:1.0:1787114968.968291:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787114968.968296:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624621056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787114968.968338:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787114968.968368:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624621056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114968.968373:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1787114968.968396:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af0513a8e00 x1873925624621056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114968.968419:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624621056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787114968.968494:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07398aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624620288:0@lo:400:kworker.0 00000100:00100000:0.0:1787114968.968505:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07398ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624620928:0@lo:400:kworker.0 00010000:00010000:0.0:1787114969.416910:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114969.481062:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787114969.481086:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b6a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624621184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787114969.481209:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114969.486956:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624621184 00000100:00100000:1.0:1787114969.486973:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624621184 00000100:00100000:1.0:1787114969.487056:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787114969.487068:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1873925624621184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787114969.487160:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787114969.487261:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1873925624621184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 195us (6051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114969.487269:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787114969.491581:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b6a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624621184:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787114969.629951:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:3.0:1787114970.437273:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114971.461599:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114972.485803:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114973.509880:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114973.569449:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114973.569494:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114973.569547:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114973.569576:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114973.569604:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602566144 00000100:00100000:0.0:1787114973.569613:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602566144 00000100:00100000:0.0:1787114973.569662:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 279 00000100:00100000:0.0:1787114973.569687:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051311c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2361:x1873925602566144:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787114973.569754:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051311c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2361:x1873925602566144:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 70us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114973.569762:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 279 00000100:00100000:0.0:1787114973.569792:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602566400 00000100:00100000:0.0:1787114973.569796:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602566400 00000100:00100000:0.0:1787114973.569830:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 52 00000100:00100000:0.0:1787114973.569836:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2361:x1873925602566400:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787114973.569867:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2361:x1873925602566400:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 31us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114973.569873:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 52 00000100:00080000:0.0:1787114973.569994:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787114973.570347:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602566272 00000100:00100000:2.0:1787114973.570351:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602566272 00000100:00100000:2.0:1787114973.570407:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602566528 00000100:00100000:2.0:1787114973.570411:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602566528 00000100:00100000:2.0:1787114973.570436:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 122 00000100:00100000:2.0:1787114973.570444:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2361:x1873925602566272:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787114973.570481:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2361:x1873925602566272:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 39us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114973.570489:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 122 00000100:00100000:2.0:1787114973.570501:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 123 00000100:00100000:2.0:1787114973.570507:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+5:2361:x1873925602566528:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787114973.570544:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+5:2361:x1873925602566528:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 36us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114973.570550:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 123 00000100:00080000:0.0:1787114973.572825:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787114974.085924:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624621312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787114974.085999:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114974.086090:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624621312 00000100:00100000:3.0:1787114974.086098:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624621312 00000100:00100000:3.0:1787114974.086166:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787114974.086174:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624621312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787114974.086224:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787114974.086281:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624621312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114974.086289:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1787114974.086337:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af0513a8e00 x1873925624621312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114974.086356:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624621312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787114974.086762:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624621696:0@lo:400:kworker.0 00000100:00100000:1.0:1787114974.086796:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114974.086818:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787114974.086823:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624621568:0@lo:400:kworker.0 00000100:00100000:1.0:1787114974.086844:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114974.086931:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624621440:0@lo:400:kworker.0 00000100:00100000:0.0:1787114974.086966:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114974.087000:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624621952:0@lo:400:kworker.0 00000100:00100000:0.0:1787114974.087025:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114974.087046:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787114974.087051:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624621824:0@lo:400:kworker.0 00000100:00100000:0.0:1787114974.087072:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114974.087101:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624621952 00000100:00100000:0.0:1787114974.087127:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624621952 00000100:00100000:0.0:1787114974.087161:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787114974.087169:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624621952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114974.087207:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624621952:12345-0@lo:400:kworker.0 Request processed in 39us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114974.087309:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787114974.087329:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624621696 00000100:00100000:0.0:1787114974.087333:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624621696 00000100:00100000:0.0:1787114974.087356:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624621568 00000100:00100000:0.0:1787114974.087359:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624621568 00000100:00100000:0.0:1787114974.087469:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624621824 00000100:00100000:0.0:1787114974.087474:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624621824 00000100:00100000:0.0:1787114974.087494:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787114974.087500:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624621696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114974.087535:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624621696:12345-0@lo:400:kworker.0 Request processed in 35us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114974.087541:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787114974.087553:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787114974.087559:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624621568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114974.087585:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624621568:12345-0@lo:400:kworker.0 Request processed in 26us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114974.087591:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787114974.087602:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787114974.087609:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624621824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114974.087637:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624621824:12345-0@lo:400:kworker.0 Request processed in 30us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114974.087643:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1787114974.087658:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787114974.087662:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787114974.087665:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787114974.087692:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624621824:0@lo:400:kworker.0 00000100:00100000:0.0:1787114974.087714:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1787114974.087719:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8af06eb72300, transno 4294967300 00000100:00100000:0.0:1787114974.087729:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624621952:0@lo:400:kworker.0 00000100:00100000:1.0:1787114974.087810:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624621440 00000100:00100000:1.0:1787114974.087815:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624621440 00000100:00100000:1.0:1787114974.087847:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787114974.087853:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051313050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624621440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114974.087892:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051313050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624621440:12345-0@lo:400:kworker.0 Request processed in 40us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114974.087898:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787114974.087930:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624621568:0@lo:400:kworker.0 00000100:00100000:1.0:1787114974.087939:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624621696:0@lo:400:kworker.0 00000100:00100000:1.0:1787114974.087958:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624621440:0@lo:400:kworker.0 00010000:00010000:3.0:1787114974.533497:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114974.598286:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624622080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787114974.598359:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114974.598539:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624622080 00000100:00100000:1.0:1787114974.598548:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624622080 00000100:00100000:1.0:1787114974.598605:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787114974.598615:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624622080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787114974.598649:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787114974.598718:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624622080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114974.598726:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787114974.598770:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624622080:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787114975.559004:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114976.581383:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787114976.969500:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787114977.606135:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787114978.629276:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114978.686582:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114978.686624:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114978.686660:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114978.686680:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114978.686875:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602566912 00000100:00100000:2.0:1787114978.686886:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602566912 00000100:00100000:2.0:1787114978.686951:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 54 00000100:00100000:2.0:1787114978.686961:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2362:x1873925602566912:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787114978.687024:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2362:x1873925602566912:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 65us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114978.687045:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 54 00000100:00100000:2.0:1787114978.687069:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602566784 00000100:00100000:2.0:1787114978.687072:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602566784 00000100:00100000:2.0:1787114978.687098:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602567040 00000100:00100000:2.0:1787114978.687101:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602567040 00000100:00100000:2.0:1787114978.687142:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 127 00000100:00100000:2.0:1787114978.687149:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2362:x1873925602566784:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787114978.687176:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2362:x1873925602566784:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 28us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114978.687181:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 127 00000100:00100000:2.0:1787114978.687192:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 128 00000100:00100000:2.0:1787114978.687197:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602567040:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787114978.687218:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602567040:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 21us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114978.687223:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 128 00000100:00100000:3.0:1787114978.687405:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602566656 00000100:00100000:3.0:1787114978.687409:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602566656 00000100:00100000:3.0:1787114978.687448:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 281 00000100:00100000:3.0:1787114978.687455:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051313c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602566656:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787114978.687481:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051313c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602566656:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 27us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114978.687488:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 281 00000100:00080000:0.0:1787114978.688142:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787114978.688148:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787114979.205858:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624622336:0@lo:400:kworker.0 00000100:00100000:0.0:1787114979.205928:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114979.205989:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624622848:0@lo:400:kworker.0 00000100:00100000:0.0:1787114979.206016:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114979.206047:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787114979.206053:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051362d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624622464:0@lo:400:kworker.0 00000100:00100000:0.0:1787114979.206087:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114979.206138:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624622848 00000100:00100000:0.0:1787114979.206145:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624622848 00000100:00100000:0.0:1787114979.206201:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787114979.206209:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624622848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114979.206275:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624622848:12345-0@lo:400:kworker.0 Request processed in 66us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114979.206282:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787114979.206320:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624622336 00000100:00100000:0.0:1787114979.206323:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624622336 00000100:00100000:0.0:1787114979.206345:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624622464 00000100:00100000:0.0:1787114979.206348:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624622464 00000100:00100000:0.0:1787114979.206370:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787114979.206376:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624622336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114979.206408:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624622336:12345-0@lo:400:kworker.0 Request processed in 33us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114979.206414:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787114979.206425:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787114979.206431:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624622464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114979.206456:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624622464:12345-0@lo:400:kworker.0 Request processed in 25us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114979.206462:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1787114979.206479:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787114979.206483:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787114979.206518:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051362d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624622464:0@lo:400:kworker.0 00000100:00100000:0.0:1787114979.206529:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624622336:0@lo:400:kworker.0 00000100:00100000:0.0:1787114979.206538:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624622848:0@lo:400:kworker.0 00000100:00100000:2.0:1787114979.206632:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624622592:0@lo:400:kworker.0 00000100:00100000:2.0:1787114979.206663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114979.206696:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787114979.206702:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624622208:0@lo:400:kworker.0 00000100:00100000:2.0:1787114979.206728:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114979.206750:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624622720:0@lo:400:kworker.0 00000100:00100000:2.0:1787114979.206772:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114979.206798:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624622208 00000100:00100000:2.0:1787114979.206802:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624622208 00000100:00100000:2.0:1787114979.206829:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787114979.206842:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051312850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624622208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114979.206875:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051312850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624622208:12345-0@lo:400:kworker.0 Request processed in 34us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114979.206882:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787114979.206906:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624622720 00000100:00100000:2.0:1787114979.206910:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624622720 00000100:00100000:2.0:1787114979.206936:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787114979.206941:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624622720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114979.206967:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624622720:12345-0@lo:400:kworker.0 Request processed in 26us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114979.206974:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1787114979.206987:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787114979.207002:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624622208:0@lo:400:kworker.0 00000100:00100000:2.0:1787114979.207012:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624622720:0@lo:400:kworker.0 00000100:00100000:0.0:1787114979.207856:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624622592 00000100:00100000:0.0:1787114979.207861:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624622592 00000100:00100000:0.0:1787114979.207907:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787114979.207916:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624622592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114979.207965:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624622592:12345-0@lo:400:kworker.0 Request processed in 51us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114979.207971:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787114979.208063:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b6a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624622976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787114979.208099:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787114979.208917:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787114979.208954:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af051363100 x1873925624622592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787114995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114979.208967:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624622592:0@lo:400:kworker.0 00000100:00100000:0.0:1787114979.209425:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624622976 00000100:00100000:0.0:1787114979.209432:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624622976 00000100:00100000:0.0:1787114979.209482:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787114979.209490:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624622976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787114979.209523:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787114979.209602:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624622976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114979.209607:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1787114979.210017:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07b6a5f80 x1873925624622976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787114995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114979.210039:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b6a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624622976:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787114979.653410:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114979.719918:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787114979.719941:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b6a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624623104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787114979.720005:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114979.720168:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624623104 00000100:00100000:0.0:1787114979.720178:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624623104 00000100:00100000:0.0:1787114979.720233:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787114979.720243:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624623104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787114979.720275:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787114979.720322:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624623104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114979.720329:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787114979.720942:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b6a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624623104:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787114980.677504:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114981.701402:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787114982.728990:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787114983.749593:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787114983.813339:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114983.813398:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114983.813535:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602567296 00000100:00100000:0.0:1787114983.813552:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602567296 00000100:00100000:0.0:1787114983.813653:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 132 00000100:00100000:2.0:1787114983.813662:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602567168 00000100:00100000:2.0:1787114983.813666:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602567168 00000100:00100000:0.0:1787114983.813666:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2363:x1873925602567296:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787114983.813733:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 283 00000100:00100000:2.0:1787114983.813740:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051310c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2363:x1873925602567168:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787114983.813771:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051310c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2363:x1873925602567168:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 30us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114983.813771:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2363:x1873925602567296:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 109us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114983.813780:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 132 00000100:00100000:2.0:1787114983.813794:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 283 00000100:00080000:3.0:1787114983.814898:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787114983.818608:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114983.819872:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602567424 00000100:00100000:2.0:1787114983.819897:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602567424 00000100:00100000:2.0:1787114983.820079:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00100000:2.0:1787114983.820098:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2360:x1873925602567424:12345-192.168.202.10@tcp:9:kworker.0 00000020:00000080:2.0:1787114983.820264:0:6578:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c84c4 00000100:00080000:2.0:1787114983.820285:0:6578:0:(import.c:65:import_set_state_nolock()) ffff8af07fb04800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787114983.820612:0:6578:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1787114983.821086:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+2:2360:x1873925602567424:12345-192.168.202.10@tcp:9:kworker.0 Request processed in 991us (2501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114983.821099:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00080000:3.0:1787114983.822052:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787114983.822462:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114983.829023:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114983.829303:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602567552 00000100:00100000:2.0:1787114983.829318:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602567552 00000100:00100000:2.0:1787114983.829554:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 133 00000100:00100000:2.0:1787114983.829568:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067b55fc-03d7-46d6-801a-48936d919d16+5:2363:x1873925602567552:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787114983.829679:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067b55fc-03d7-46d6-801a-48936d919d16+5:2363:x1873925602567552:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 114us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114983.829689:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 133 00000100:00080000:3.0:1787114983.829747:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787114984.326028:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624623488:0@lo:400:kworker.0 00000100:00100000:0.0:1787114984.326154:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114984.326274:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787114984.326282:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624623360:0@lo:400:kworker.0 00000100:00100000:0.0:1787114984.326307:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114984.326327:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af051363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624623872:0@lo:400:kworker.0 00000100:00100000:0.0:1787114984.326527:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114984.326568:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624623488 00000100:00100000:0.0:1787114984.326580:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624623488 00000100:00100000:2.0:1787114984.327496:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624623872 00000100:00100000:2.0:1787114984.327502:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624623872 00000100:00100000:2.0:1787114984.327560:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787114984.327574:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624623872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114984.327858:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624623360 00000100:00100000:0.0:1787114984.327863:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624623360 00000100:00100000:0.0:1787114984.327893:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787114984.327901:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624623488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114984.328011:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624623616:0@lo:400:kworker.0 00000100:00100000:1.0:1787114984.328084:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624623232:0@lo:400:kworker.0 00000100:00100000:0.0:1787114984.337154:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624623488:12345-0@lo:400:kworker.0 Request processed in 9237us (10982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114984.337183:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787114984.341612:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787114984.341731:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624623360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114984.341902:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624623360:12345-0@lo:400:kworker.0 Request processed in 200us (15593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114984.341911:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787114984.342031:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b6a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624624000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787114984.342094:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114984.342512:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624623360:0@lo:400:kworker.0 00000100:00100000:0.0:1787114984.342532:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624623488:0@lo:400:kworker.0 00000100:00100000:0.0:1787114984.342602:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624624000 00000100:00100000:0.0:1787114984.342611:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624624000 00000100:00100000:0.0:1787114984.343139:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787114984.343148:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624624000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787114984.343195:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787114984.345183:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624624000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2007us (3060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114984.345205:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1787114984.345752:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07b6a5180 x1873925624624000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787115000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114984.345786:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b6a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624624000:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787114984.345982:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787114984.345989:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787114984.345994:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787114984.346442:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114984.346862:0:6578:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787114984.346878:0:6578:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787114984.348863:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624623616 00000100:00100000:3.0:1787114984.348885:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624623616 00000100:00100000:3.0:1787114984.348967:0:6578:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787114984.348987:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787114984.349001:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624623616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114984.349160:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624623616:12345-0@lo:400:kworker.0 Request processed in 162us (2718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114984.349169:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1787114984.349773:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af042cbbb80 x1873925624623616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787115000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787114984.349793:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624623616:0@lo:400:kworker.0 00000100:00100000:1.0:1787114984.350019:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114984.350084:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873925624623744:0@lo:400:kworker.0 00000100:00100000:1.0:1787114984.350158:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114984.350478:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624623744 00000100:00100000:0.0:1787114984.350487:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624623744 00000100:00100000:0.0:1787114984.350545:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787114984.350554:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873925624623744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787114984.350612:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873925624623744:12345-0@lo:400:kworker.0 Request processed in 60us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114984.350619:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787114984.350750:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873925624623744:0@lo:400:kworker.0 00000100:00080000:1.0:1787114984.350785:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787114984.352567:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624623232 00000100:00100000:3.0:1787114984.352585:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624623232 00000100:00100000:3.0:1787114984.352772:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787114984.352786:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3307:x1873925624623232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114984.352999:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3307:x1873925624623232:12345-0@lo:400:kworker.0 Request processed in 216us (2980us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114984.353008:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787114984.354091:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624623872:12345-0@lo:400:kworker.0 Request processed in 26513us (27556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114984.354140:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787114984.354537:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af051363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624623872:0@lo:400:kworker.0 00000100:00100000:0.0:1787114984.354880:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624623232:0@lo:400:kworker.0 00010000:00010000:0.0:1787114984.773690:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787114984.850807:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624624128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787114984.850882:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114984.850974:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624624128 00000100:00100000:1.0:1787114984.850984:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624624128 00000100:00100000:1.0:1787114984.851417:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787114984.851433:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624624128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787114984.851474:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787114984.851530:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624624128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114984.851538:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787114984.851597:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624624128:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1787114985.001553:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6aef9ffe-3b7b-498c-9a5a-a012c6970297 00000020:00000080:1.0:1787114985.001563:0:7483:0:(genops.c:906:class_export_put()) final put ffff8af07fb01000/6aef9ffe-3b7b-498c-9a5a-a012c6970297 00000020:00000080:0.0:1787114985.001674:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8af07fb01000/6aef9ffe-3b7b-498c-9a5a-a012c6970297 for lustre-OST0001 00000020:00000080:0.0:1787114985.001752:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af07fb04800 for lustre-OST0001 00010000:00010000:3.0:1787114985.797247:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787114986.182474:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787114986.825738:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114987.845562:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114988.870260:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787114988.925360:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114988.925400:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114988.925426:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114988.925477:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602567936 00000100:00100000:1.0:1787114988.925487:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602567936 00000100:00100000:1.0:1787114988.925545:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602567808 00000100:00100000:1.0:1787114988.925547:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602567808 00000100:00100000:1.0:1787114988.925568:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 137 00000100:00100000:1.0:1787114988.925577:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602567936:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114988.925647:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602567936:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 72us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114988.925655:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 137 00000100:00100000:1.0:1787114988.925671:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 138 00000100:00100000:1.0:1787114988.925676:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07398aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2362:x1873925602567808:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114988.925712:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07398aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2362:x1873925602567808:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 36us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114988.925717:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 138 00000100:00100000:0.0:1787114988.925935:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602567680 00000100:00100000:0.0:1787114988.925939:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602567680 00000100:00100000:0.0:1787114988.925979:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 285 00000100:00100000:0.0:1787114988.925986:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602567680:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787114988.926018:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602567680:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 33us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114988.926024:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 285 00000100:00080000:3.0:1787114988.926237:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787114989.448843:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b6a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624624256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787114989.449029:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114989.450078:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624624256 00000100:00100000:0.0:1787114989.450093:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624624256 00000100:00100000:0.0:1787114989.450203:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787114989.450214:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624624256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787114989.450251:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787114989.450324:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624624256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114989.450332:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1787114989.450375:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07b6a7480 x1873925624624256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787115005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787114989.450396:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b6a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624624256:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787114989.452121:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787114989.465549:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624624512:0@lo:400:kworker.0 00000100:00100000:3.0:1787114989.465621:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114989.465670:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787114989.465677:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624624384:0@lo:400:kworker.0 00000100:00100000:3.0:1787114989.465705:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114989.465729:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624624896:0@lo:400:kworker.0 00000100:00100000:3.0:1787114989.465753:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114989.465780:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624624640:0@lo:400:kworker.0 00000100:00100000:3.0:1787114989.465803:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114989.465822:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787114989.465827:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624624768:0@lo:400:kworker.0 00000100:00100000:3.0:1787114989.465844:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114989.465872:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624624512 00000100:00100000:3.0:1787114989.465878:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624624512 00000100:00100000:3.0:1787114989.467874:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624624640 00000100:00100000:3.0:1787114989.467886:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624624640 00000100:00100000:3.0:1787114989.468616:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624624768 00000100:00100000:3.0:1787114989.468623:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624624768 00000100:00100000:3.0:1787114989.468648:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787114989.468657:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624624512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114989.468762:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624624512:12345-0@lo:400:kworker.0 Request processed in 105us (3141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114989.468769:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787114989.468788:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787114989.468795:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624624640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114989.468829:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624624640:12345-0@lo:400:kworker.0 Request processed in 35us (3025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114989.468836:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787114989.468848:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787114989.468854:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624624768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114989.468883:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624624768:12345-0@lo:400:kworker.0 Request processed in 29us (3037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114989.468889:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1787114989.471233:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787114989.473155:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624624384 00000100:00100000:3.0:1787114989.473180:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624624384 00000100:00100000:3.0:1787114989.473252:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787114989.473261:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624624384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114989.474430:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624624896 00000100:00100000:2.0:1787114989.474439:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624624896 00000100:00100000:2.0:1787114989.474488:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787114989.474496:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624624896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114989.474585:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624624896:12345-0@lo:400:kworker.0 Request processed in 90us (8830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114989.474592:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1787114989.474616:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787114989.475651:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624624384:12345-0@lo:400:kworker.0 Request processed in 2388us (9942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114989.475662:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787114989.476822:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624624768:0@lo:400:kworker.0 00000100:00100000:3.0:1787114989.476851:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624624640:0@lo:400:kworker.0 00000100:00100000:3.0:1787114989.476888:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624624384:0@lo:400:kworker.0 00000100:00100000:3.0:1787114989.476899:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624624896:0@lo:400:kworker.0 00000100:00100000:3.0:1787114989.477881:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624624512:0@lo:400:kworker.0 00000001:02000400:3.0:1787114989.812213:0:11683:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 00:49:48 (1787114988) 00010000:00010000:3.0:1787114989.895145:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114989.958483:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787114989.958508:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b6a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624625024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787114989.958579:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114989.958636:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624625024 00000100:00100000:2.0:1787114989.958643:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624625024 00000100:00100000:2.0:1787114989.958688:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787114989.958698:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624625024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787114989.958731:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787114989.958776:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624625024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114989.958783:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787114989.958830:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b6a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624625024:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787114990.917642:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787114991.898037:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114991.898381:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602568064 00000100:00100000:1.0:1787114991.898391:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602568064 00000100:00100000:1.0:1787114991.898476:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 32 00000100:00100000:1.0:1787114991.898489:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:10211:x1873925602568064:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787114991.898514:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787114991.898551:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c858f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d144e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.898617:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8596 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.898632:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.898645:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787114991.898840:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787114991.898845:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787114991.898937:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.898960:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c858f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d144e expref: 7 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.898976:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8596 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d144e expref: 6 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.898996:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0510d6500) 00010000:00010000:1.0:1787114991.898999:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787114991.899002:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a1a00, rc 0) 00000100:00100000:1.0:1787114991.899066:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:10211:x1873925602568064:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 580us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114991.899073:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 32 00000100:00080000:2.0:1787114991.899456:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787114991.908494:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114991.908640:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602568192 00000100:00100000:2.0:1787114991.908651:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602568192 00000100:00100000:2.0:1787114991.908712:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 33 00000100:00100000:2.0:1787114991.908721:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:10212:x1873925602568192:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787114991.908753:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114991.908771:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c859d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1455 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.908830:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c85a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.908844:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c85a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.908854:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c85a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.908866:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c85ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.908872:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c85ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.908878:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c85ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.909289:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c85b2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.909299:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c85b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.909307:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c85b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787114991.909383:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787114991.909392:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787114991.909468:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c85b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.909480:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c85a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.909487:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c85a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.909494:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c85a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.909500:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2a00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787114991.909505:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c85a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.909511:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c85a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.909589:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0510d6500) 00010000:00010000:2.0:1787114991.909593:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787114991.909598:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c85a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.909605:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c85a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.909618:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c85ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.909624:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c85ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.909641:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c85ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.909646:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3a00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787114991.909649:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c85ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.909655:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c85ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.909664:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8af0514c6400) 00010000:00010000:2.0:1787114991.909666:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787114991.909669:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c85ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.909674:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c85ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.909703:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c859d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1455 expref: 8 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.909715:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c85b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1455 expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114991.909722:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8af0514c6700) 00010000:00010000:2.0:1787114991.909724:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787114991.909726:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3000, rc 0) 00000100:00100000:2.0:1787114991.909845:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:10212:x1873925602568192:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 1124us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114991.909863:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 33 00000100:00100000:3.0:1787114991.919753:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114991.919850:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602568448 00000100:00100000:1.0:1787114991.919859:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602568448 00000100:00100000:1.0:1787114991.919921:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 34 00000100:00100000:1.0:1787114991.919932:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:10212:x1873925602568448:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787114991.919952:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787114991.919973:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c85b9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d145c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.920042:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c85c0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.920055:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c85c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.920066:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c85c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.920170:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c85c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.920180:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c85c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.920201:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c85c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.920881:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1600/0x194cd781e88c85ce lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.920892:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1600/0x194cd781e88c85ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.920900:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1600/0x194cd781e88c85ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787114991.920910:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787114991.921142:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c85c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.921151:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c85c0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.921157:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c85c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.921164:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0a00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787114991.921169:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c85c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.921176:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c85c0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.921190:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8af0514c6700) 00010000:00010000:1.0:1787114991.921193:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787114991.921204:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c85c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.921212:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c85c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.921225:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c85c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.921231:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c85c7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.921237:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c85c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.921242:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787114991.921245:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c85c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.921251:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c85c7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.921258:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8af0510d6400) 00010000:00010000:1.0:1787114991.921261:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787114991.921264:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c85c7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.921586:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c85c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.921974:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c85b9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d145c expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.922000:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1600/0x194cd781e88c85ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d145c expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114991.922009:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8af0510d6d00) 00010000:00010000:1.0:1787114991.922011:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787114991.922014:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a1600, rc 0) 00000100:00100000:1.0:1787114991.922866:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:10212:x1873925602568448:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 2931us (3119us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787114991.922876:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 34 00000100:00100000:3.0:1787114991.940707:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114991.940957:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602568576 00000100:00100000:2.0:1787114991.940968:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602568576 00000100:00100000:2.0:1787114991.941031:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 35 00000100:00100000:2.0:1787114991.941042:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:10212:x1873925602568576:12345-192.168.202.10@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787114991.941211:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:10212:x1873925602568576:12345-192.168.202.10@tcp:59:lhsmtool_posix.0 Request processed in 170us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114991.941218:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 35 00010000:00010000:1.0:1787114991.942168:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787114992.326646:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787114992.967288:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787114993.990735:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114994.056478:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114994.056518:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114994.056545:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114994.056577:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602568960 00000100:00100000:0.0:1787114994.056587:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602568960 00000100:00100000:0.0:1787114994.056636:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602568832 00000100:00100000:0.0:1787114994.056638:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602568832 00000100:00100000:0.0:1787114994.056653:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 142 00000100:00100000:0.0:1787114994.056660:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+5:2361:x1873925602568960:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114994.056825:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602568704 00000100:00100000:1.0:1787114994.056830:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602568704 00000100:00100000:1.0:1787114994.056869:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 287 00000100:00100000:1.0:1787114994.056876:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2361:x1873925602568704:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114994.056903:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2361:x1873925602568704:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 28us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114994.056910:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 287 00000100:00100000:1.0:1787114994.056938:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 143 00000100:00100000:1.0:1787114994.056942:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:2361:x1873925602568832:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787114994.056960:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:2361:x1873925602568832:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 18us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114994.056964:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 143 00000100:00080000:1.0:1787114994.057171:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787114994.057216:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+5:2361:x1873925602568960:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 60us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114994.057225:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 142 00000100:00100000:0.0:1787114994.356020:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114994.358977:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602569088 00000100:00100000:1.0:1787114994.358997:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602569088 00000100:00100000:1.0:1787114994.359055:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 36 00000100:00100000:1.0:1787114994.359064:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:10254:x1873925602569088:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1787114994.359095:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787114994.359131:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c85dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1463 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359194:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c85e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359208:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c85e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359222:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c85e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359236:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c85ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359242:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c85ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359305:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c85ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359522:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c85e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359530:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c85e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359537:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c85e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359547:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787114994.359551:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c85e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359559:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c85e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359571:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0510d6500) 00010000:00010000:1.0:1787114994.359574:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787114994.359578:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c85e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359584:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c85e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359593:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c85ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359599:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c85ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359605:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c85ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359610:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787114994.359613:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c85ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359618:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c85ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359632:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8af0510d6400) 00010000:00010000:1.0:1787114994.359634:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787114994.359637:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c85ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359642:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c85ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359668:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c85dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1463 expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359677:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0510d6500) 00010000:00010000:1.0:1787114994.359679:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787114994.359682:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c85dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1463 expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.359690:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a1800, rc 0) 00000100:00100000:1.0:1787114994.359750:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:10254:x1873925602569088:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 687us (3739us total) trans 0 rc 301/301 00000100:00100000:1.0:1787114994.359757:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 36 00000100:00100000:1.0:1787114994.364711:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114994.391200:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602569344 00000100:00100000:2.0:1787114994.391217:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602569344 00000100:00100000:2.0:1787114994.391370:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 37 00000100:00100000:2.0:1787114994.391381:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:10254:x1873925602569344:12345-192.168.202.10@tcp:36:lfs.0 00010000:00010000:2.0:1787114994.391437:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787114994.391467:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8596 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d144e expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.391485:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0510d6500) 00010000:00010000:2.0:1787114994.391497:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787114994.391817:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c85f1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.391832:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c85f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.391843:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c85f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.391864:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c85f8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.391872:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c85f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.391879:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c85f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787114994.393028:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787114994.393042:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c85f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.393051:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c85f1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.393058:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c85f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.393065:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2800 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787114994.393069:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c85f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.393077:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c85f1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.393236:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0514c6a00) 00010000:00010000:2.0:1787114994.393240:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787114994.393244:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c85f1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.393262:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c85f1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787114994.393280:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000110974ed reply state 000000006302824d transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c85f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114994.393290:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787114994.393401:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+10:10254:x1873925602569344:12345-192.168.202.10@tcp:36:lfs.0 Request processed in 2018us (28692us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787114994.393410:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 37 00010000:00010000:2.0:1787114994.400336:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c85f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.400366:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c85f8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.400373:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c85f8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.400388:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787114994.400393:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c85f8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.400400:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c85f8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.400430:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8af0514c6c00) 00010000:00010000:2.0:1787114994.400433:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787114994.400438:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c85f8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.400483:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c85f8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114994.478510:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114994.478657:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602569472 00000100:00100000:2.0:1787114994.478673:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602569472 00000100:00100000:2.0:1787114994.478730:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 38 00000100:00100000:2.0:1787114994.478740:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:10262:x1873925602569472:12345-192.168.202.10@tcp:101:lctl.0 00010000:00010000:2.0:1787114994.478762:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114994.478784:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c85ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d146a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.478846:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c8606 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.478861:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c8606 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.478873:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c8606 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787114994.478933:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787114994.478937:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787114994.479239:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c8606 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.479275:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c85ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d146a expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.479308:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c8606 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d146a expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.479330:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0514c6c00) 00010000:00010000:2.0:1787114994.479333:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787114994.479336:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2800, rc 0) 00000100:00100000:2.0:1787114994.479406:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+10:10262:x1873925602569472:12345-192.168.202.10@tcp:101:lctl.0 Request processed in 659us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114994.479414:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 38 00000100:00100000:1.0:1787114994.528331:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114994.528778:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602569600 00000100:00100000:0.0:1787114994.528789:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602569600 00000100:00100000:0.0:1787114994.528854:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 39 00000100:00100000:0.0:1787114994.528865:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+10:10268:x1873925602569600:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:0.0:1787114994.528886:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114994.528907:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c860d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1471 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.528975:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8614 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.528991:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8614 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.529003:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8614 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.529018:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c861b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.529040:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c861b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.529048:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c861b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.529780:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c8622 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.529791:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c8622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.529799:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c8622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787114994.529844:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787114994.529848:0:7216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787114994.529889:0:7216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c8622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.529903:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8614 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.529911:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8614 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.529918:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8614 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.529924:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787114994.529929:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8614 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.529936:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8614 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.529948:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0514c6c00) 00010000:00010000:1.0:1787114994.529951:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787114994.529955:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8614 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.529962:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8614 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.529976:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c861b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.529991:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c861b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.529998:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c861b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.530002:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787114994.530005:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c861b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.530011:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c861b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.530018:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8af051ecb700) 00010000:00010000:1.0:1787114994.530021:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787114994.530023:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c861b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.530029:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c861b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.530064:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c860d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1471 expref: 12 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.531962:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c8622 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1471 expref: 11 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.531983:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:1.0:1787114994.531986:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787114994.532376:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0600, rc 0) 00000100:00100000:1.0:1787114994.532735:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+11:10268:x1873925602569600:12345-192.168.202.10@tcp:101:bash.0 Request processed in 3868us (4412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114994.532744:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 39 00000100:00100000:1.0:1787114994.545711:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114994.546603:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602569856 00000100:00100000:0.0:1787114994.546617:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602569856 00000100:00100000:0.0:1787114994.546734:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 40 00000100:00100000:0.0:1787114994.546823:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+11:10268:x1873925602569856:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:0.0:1787114994.547480:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114994.547508:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c8629 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1478 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.547671:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8630 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.547688:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8630 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.547700:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8630 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.547744:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8637 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.547753:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.547760:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787114994.549195:0:5787:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787114994.549400:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c863e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.549416:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c863e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.549428:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c863e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.549476:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8630 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.549483:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8630 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.549491:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8630 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.549498:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787114994.549502:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8630 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.549511:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8630 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.549522:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:1.0:1787114994.549533:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787114994.549538:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8630 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.549544:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8630 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787114994.549558:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cbc97626 reply state 0000000084b347c5 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114994.549567:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787114994.549608:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c8629 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1478 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.549623:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c863e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1478 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.549630:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0510d6700) 00010000:00010000:1.0:1787114994.549633:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787114994.549636:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a1200, rc 0) 00000100:00100000:1.0:1787114994.549714:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+14:10268:x1873925602569856:12345-192.168.202.10@tcp:101:bash.0 Request processed in 2969us (4011us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787114994.549723:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 40 00010000:00010000:3.0:1787114994.559766:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114994.559781:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8637 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114994.559787:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8637 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114994.559790:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787114994.559794:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8637 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114994.559799:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8637 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114994.559813:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8af051ecbd00) 00010000:00010000:3.0:1787114994.559831:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787114994.559836:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8637 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114994.559842:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8637 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114994.563444:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114994.563780:0:11535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602569984 00000100:00100000:0.0:1787114994.563789:0:11535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602569984 00000100:00100000:0.0:1787114994.563828:0:11535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 20 00000100:00100000:0.0:1787114994.563834:0:11535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1873925602569984:12345-192.168.202.10@tcp:8:bash.0 00010000:00080000:0.0:1787114994.563877:0:11535:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:0.0:1787114994.563907:0:11535:0:(genops.c:1406:class_connect()) connect: client 6aef9ffe-3b7b-498c-9a5a-a012c6970297, cookie 0x194cd781e88c864c 00002000:00100000:0.0:1787114994.563918:0:11535:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6aef9ffe-3b7b-498c-9a5a-a012c6970297/ffff8af043121000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113803 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787114994.563939:0:11535:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787114994.564154:0:11535:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787114994.564178:0:11535:0:(import.c:65:import_set_state_nolock()) ffff8af043120000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787114994.564464:0:11535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2360:x1873925602569984:12345-192.168.202.10@tcp:8:bash.0 Request processed in 628us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114994.564470:0:11535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 20 00000100:00100000:2.0:1787114994.565585:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624625408:0@lo:400:kworker.0 00000100:00100000:2.0:1787114994.565657:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114994.565711:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787114994.565719:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624625536:0@lo:400:kworker.0 00000100:00100000:2.0:1787114994.565746:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114994.565779:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624625536 00000100:00100000:2.0:1787114994.565786:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624625536 00000100:00100000:2.0:1787114994.565832:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787114994.565842:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624625536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114994.565891:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624625536:12345-0@lo:400:kworker.0 Request processed in 51us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114994.565898:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1787114994.565916:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787114994.565945:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f7bd880 x1873925624625536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787115010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787114994.565961:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624625536:0@lo:400:kworker.0 00000100:00100000:2.0:1787114994.565983:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624625408 00000100:00100000:2.0:1787114994.565987:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624625408 00000100:00100000:2.0:1787114994.566034:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787114994.566041:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624625408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114994.566076:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624625408:12345-0@lo:400:kworker.0 Request processed in 35us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114994.566093:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:2.0:1787114994.566130:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787114994.566149:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624625408:0@lo:400:kworker.0 00000100:00100000:2.0:1787114994.566975:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114994.567191:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624625152:0@lo:400:kworker.0 00000100:00100000:0.0:1787114994.567232:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114994.567263:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624625664:0@lo:400:kworker.0 00000100:00100000:0.0:1787114994.567285:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114994.567319:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787114994.567325:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624625280:0@lo:400:kworker.0 00000100:00100000:0.0:1787114994.567349:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787114994.567364:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624625792:0@lo:400:kworker.0 00000100:00100000:1.0:1787114994.567472:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624625664 00000100:00100000:1.0:1787114994.567478:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624625664 00000100:00100000:1.0:1787114994.567518:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624625280 00000100:00100000:1.0:1787114994.567521:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624625280 00000100:00100000:2.0:1787114994.567527:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787114994.567540:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787114994.567546:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624625920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787114994.567547:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624625664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114994.567573:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114994.567595:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624625664:12345-0@lo:400:kworker.0 Request processed in 48us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114994.567598:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624625920 00000100:00100000:2.0:1787114994.567601:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624625920 00000100:00100000:1.0:1787114994.567602:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787114994.567615:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787114994.567620:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624625280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114994.567647:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624625280:12345-0@lo:400:kworker.0 Request processed in 27us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114994.567652:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:1.0:1787114994.567667:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787114994.567721:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114994.567743:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787114994.567751:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624625920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787114994.567767:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787114994.567813:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624625920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114994.567818:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:1.0:1787114994.568315:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07b6a4000 x1873925624625920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787115010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787114994.568332:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624625920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787114994.569384:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602570112 00000100:00100000:3.0:1787114994.569394:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602570112 00000100:00080000:2.0:1787114994.569516:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787114994.570153:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624625792 00000100:00100000:3.0:1787114994.570160:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624625792 00000100:00100000:1.0:1787114994.570236:0:11535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787114994.570247:0:11535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624625792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787114994.570325:0:11535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624625792:12345-0@lo:400:kworker.0 Request processed in 80us (2604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114994.570333:0:11535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787114994.570352:0:11535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 21 00000100:00100000:1.0:1787114994.570359:0:11535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:0:x1873925602570112:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:1.0:1787114994.570369:0:11535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787114994.570391:0:11535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3173755/0x194cd781e88c8653 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d147f expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787114994.570418:0:11535:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787114994.570433:0:11535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=323s v=(0 0) 00010000:00010000:1.0:1787114994.570451:0:11535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787114994.570461:0:11535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3173755/0x194cd781e88c8653 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d147f expref: 7 pid: 11535 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.570482:0:11535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e3173755/0x194cd781e88c8653 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d147f expref: 7 pid: 11535 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.570496:0:11535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0800, rc 0) 00000100:00100000:1.0:1787114994.570564:0:11535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:0:x1873925602570112:12345-192.168.202.10@tcp:101:bash.0 Request processed in 205us (3593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114994.570570:0:11535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 21 00000100:00080000:2.0:1787114994.570742:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787114994.572555:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624625152 00000100:00100000:3.0:1787114994.572570:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624625152 00000100:00100000:3.0:1787114994.572683:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787114994.572693:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624625152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114994.572771:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624625152:12345-0@lo:400:kworker.0 Request processed in 79us (5537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114994.572777:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787114994.573097:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624625792:0@lo:400:kworker.0 00000100:00100000:1.0:1787114994.573137:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624625152:0@lo:400:kworker.0 00000100:00100000:1.0:1787114994.573152:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624625664:0@lo:400:kworker.0 00000100:00100000:1.0:1787114994.573183:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624625280:0@lo:400:kworker.0 00000100:00100000:1.0:1787114994.576267:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114994.576588:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602570240 00000100:00100000:0.0:1787114994.576608:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602570240 00000100:00100000:0.0:1787114994.576670:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 22 00000100:00100000:0.0:1787114994.576677:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:10268:x1873925602570240:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:0.0:1787114994.576693:0:6578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114994.576709:0:6578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe17cf0b/0x194cd781e88c865a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1486 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.576733:0:6578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3173755/0x194cd781e88c8653 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d147f expref: 8 pid: 11535 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.576740:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787114994.576745:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787114994.576748:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe17cf0b/0x194cd781e88c865a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1486 expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.576782:0:6578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e3173755/0x194cd781e88c8653 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d147f expref: 8 pid: 11535 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.576793:0:6578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e3173755/0x194cd781e88c8653 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d147f expref: 8 pid: 11535 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114994.576803:0:6578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6578:1873925624626048:192.168.202.10@tcp:104: 00000100:00100000:0.0:1787114994.576879:0:6578:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af044f4a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787114994.581523:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114994.581593:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602570368 00000100:00100000:2.0:1787114994.581602:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602570368 00000100:00100000:0.0:1787114994.581702:0:6578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6578:1873925624626048:192.168.202.10@tcp:104: 00010000:00010000:0.0:1787114994.581733:0:6578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe17cf0b/0x194cd781e88c865a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1486 expref: 9 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.581770:0:6578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052364400, rc 0) 00000100:00100000:0.0:1787114994.581826:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:10268:x1873925602570240:12345-192.168.202.10@tcp:101:bash.0 Request processed in 5148us (5568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114994.581835:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 22 00010000:00010000:2.0:1787114994.582467:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e3173755/0x194cd781e88c8653 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d147f expref: 8 pid: 11535 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114994.582497:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 35 00000100:00100000:2.0:1787114994.582515:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2364:x1873925602570368:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787114994.582531:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787114994.582556:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e3173755/0x194cd781e88c8653 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d147f expref: 8 pid: 11535 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.582566:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e3173755/0x194cd781e88c8653 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d147f expref: 8 pid: 11535 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.582586:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3173755/0x194cd781e88c8653 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d147f expref: 8 pid: 11535 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.582597:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787114994.582600:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787114994.582606:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe17cf0b/0x194cd781e88c865a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1486 expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.582613:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe17cf0b/0x194cd781e88c865a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1486 expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.583431:0:5771:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fe17cf0b/0x194cd781e88c865a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1486 expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114994.583451:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b6a5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5771:1873925624626176:192.168.202.10@tcp:105: 00000100:00100000:2.0:1787114994.583519:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5f09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787114994.589890:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b6a5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5771:1873925624626176:192.168.202.10@tcp:105: 00010000:00010000:2.0:1787114994.589933:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787114994.589988:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2364:x1873925602570368:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 7473us (8473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114994.589998:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 35 00000100:00100000:0.0:1787114994.592480:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114994.592654:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602570624 00000100:00100000:3.0:1787114994.592664:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602570624 00000100:00100000:3.0:1787114994.592720:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00100000:3.0:1787114994.592730:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+13:10268:x1873925602570624:12345-192.168.202.10@tcp:35:bash.0 00000100:00100000:3.0:1787114994.593091:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+14:10268:x1873925602570624:12345-192.168.202.10@tcp:35:bash.0 Request processed in 353us (610us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787114994.593100:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00100000:1.0:1787114994.727024:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114994.727293:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602570880 00000100:00100000:2.0:1787114994.727303:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602570880 00000100:00100000:0.0:1787114994.728474:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 41 00000100:00100000:0.0:1787114994.728486:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+14:10278:x1873925602570880:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1787114994.728520:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114994.728551:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8661 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d148d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787114994.728660:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787114994.728773:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8661 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d148d expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.728787:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0514c6c00) 00010000:00010000:0.0:1787114994.728791:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787114994.728797:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8661 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d148d expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.728811:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052364c00, rc 0) 00000100:00100000:0.0:1787114994.728889:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+15:10278:x1873925602570880:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 404us (1873us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1787114994.728897:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 41 00000100:00100000:2.0:1787114994.746439:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114994.746534:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602571136 00000100:00100000:1.0:1787114994.746544:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602571136 00000100:00100000:1.0:1787114994.746597:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:1.0:1787114994.746606:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+15:10278:x1873925602571136:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:1.0:1787114994.746860:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+16:10278:x1873925602571136:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 254us (430us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787114994.746884:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:1.0:1787114994.791321:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114994.791964:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602571264 00000100:00100000:2.0:1787114994.791977:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602571264 00000100:00100000:2.0:1787114994.796121:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 42 00000100:00100000:2.0:1787114994.796145:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+16:10284:x1873925602571264:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1787114994.796170:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114994.796192:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c866f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1494 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.796272:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c8676 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.796286:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c8676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.796298:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c8676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787114994.796355:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787114994.796358:0:7216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787114994.796381:0:7216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c8676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.796404:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c866f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1494 expref: 18 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.796438:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c8676 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1494 expref: 17 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.796448:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:2.0:1787114994.796452:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787114994.796455:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3a00, rc 0) 00000100:00100000:2.0:1787114994.796526:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+17:10284:x1873925602571264:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 393us (5215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114994.796962:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 42 00000100:00100000:0.0:1787114994.803260:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114994.803388:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602571520 00000100:00100000:1.0:1787114994.803398:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602571520 00000100:00100000:1.0:1787114994.803470:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 43 00000100:00100000:1.0:1787114994.803480:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+17:10284:x1873925602571520:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1787114994.803514:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787114994.803554:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c867d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d149b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.803659:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.803675:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.803688:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787114994.803699:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787114994.803908:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c867d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d149b expref: 20 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.803926:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d149b expref: 19 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.803936:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0510d6700) 00010000:00010000:1.0:1787114994.803939:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787114994.803950:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0800, rc 0) 00000100:00100000:1.0:1787114994.804041:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+19:10284:x1873925602571520:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 562us (789us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787114994.804049:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 43 00000100:00100000:1.0:1787114994.813338:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114994.813396:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602571648 00000100:00100000:3.0:1787114994.813407:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602571648 00000100:00100000:3.0:1787114994.813473:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 2 00000100:00100000:3.0:1787114994.813482:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+19:2364:x1873925602571648:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787114994.813511:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787114994.813535:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8684 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d149b expref: 19 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114994.813554:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0510d6700) 00010000:00010000:3.0:1787114994.813559:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787114994.813616:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:2364:x1873925602571648:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 135us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114994.813624:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 2 00000100:00100000:0.0:1787114994.815906:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114994.816016:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602571904 00000100:00100000:2.0:1787114994.816025:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602571904 00000100:00100000:2.0:1787114994.816227:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 44 00000100:00100000:2.0:1787114994.816238:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:10284:x1873925602571904:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1787114994.816314:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114994.816336:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8692 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d14a2 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.816420:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8699 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.816435:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8699 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.816448:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8699 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787114994.816460:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787114994.816588:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8692 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14a2 expref: 21 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.816605:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8699 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14a2 expref: 20 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.816616:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0510d6700) 00010000:00010000:2.0:1787114994.816727:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787114994.816732:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2e00, rc 0) 00000100:00100000:2.0:1787114994.816823:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+20:10284:x1873925602571904:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 587us (980us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787114994.816831:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 44 00000100:00100000:0.0:1787114994.820264:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114994.820447:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602572032 00000100:00100000:2.0:1787114994.820456:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602572032 00000100:00100000:2.0:1787114994.820543:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 23 00000100:00100000:2.0:1787114994.820553:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2363:x1873925602572032:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:2.0:1787114994.820596:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c86a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.820628:0:6577:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe17cf0b/0x194cd781e88c865a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1486 expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.820638:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787114994.820643:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787114994.820648:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c86a7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.820681:0:6577:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe17cf0b/0x194cd781e88c865a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1486 expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.820709:0:6577:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe17cf0b/0x194cd781e88c865a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1486 expref: 7 pid: 6578 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114994.820725:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b6a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6577:1873925624626304:192.168.202.10@tcp:104: 00000100:00100000:2.0:1787114994.820807:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5f09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787114994.823816:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b6a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6577:1873925624626304:192.168.202.10@tcp:104: 00010000:00010000:2.0:1787114994.823847:0:6577:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c86a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114994.825939:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114994.826182:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602572160 00000100:00100000:1.0:1787114994.826192:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602572160 00002000:00100000:1.0:1787114994.826237:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8af073aeea00 x1873925602572160/t0(0) o4->6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp:560/0 lens 504/0 e 0 to 0 dl 1787115005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787114994.826248:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af073aeea00 with x1873925602572160 ext(0->12) 00010000:00010000:1.0:1787114994.826256:0:6582:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fe17cf0b/0x194cd781e88c865a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1486 expref: 8 pid: 6578 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.826274:0:6582:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fe17cf0b/0x194cd781e88c865a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1486 expref: 8 pid: 6578 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787114994.826281:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8af073aeea00 00000100:00100000:1.0:1787114994.826313:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:1.0:1787114994.826324:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2363:x1873925602572160:12345-192.168.202.10@tcp:4:lfs.0 00000001:00100000:2.0:1787114994.845984:0:6604:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6aef9ffe-3b7b-498c-9a5a-a012c6970297 00000100:00100000:3.0:1787114994.846622:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:2363:x1873925602572160:12345-192.168.202.10@tcp:4:lfs.0 Request processed in 20294us (20687us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787114994.846640:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 0 00002000:00100000:3.0:1787114994.846655:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8af073aeea00 x1873925602572160/t4294967299(0) o4->6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp:560/0 lens 504/448 e 0 to 0 dl 1787115005 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787114994.846667:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af073aeea00 with x1873925602572160 ext(0->12) 00010000:00010000:3.0:1787114994.846678:0:6582:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fe17cf0b/0x194cd781e88c865a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1486 expref: 9 pid: 6578 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114994.846698:0:6582:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fe17cf0b/0x194cd781e88c865a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1486 expref: 9 pid: 6578 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787114994.846708:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8af073aeea00 00000100:00100000:1.0:1787114994.863360:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114994.870021:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602572288 00000100:00100000:2.0:1787114994.870070:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602572288 00010000:00010000:2.0:1787114994.870208:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe17cf0b/0x194cd781e88c865a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1486 expref: 9 pid: 6578 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114994.870252:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 36 00000100:00100000:2.0:1787114994.870263:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f961f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:2363:x1873925602572288:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787114994.870361:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787114994.870407:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787114994.870410:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787114995 00002000:00010000:2.0:1787114994.870412:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787114995 00002000:00010000:2.0:1787114994.870415:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787114995 00010000:00010000:2.0:1787114994.870451:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe17cf0b/0x194cd781e88c865a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1486 expref: 9 pid: 6578 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.870500:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe17cf0b/0x194cd781e88c865a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1486 expref: 9 pid: 6578 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.870591:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe17cf0b/0x194cd781e88c865a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1486 expref: 9 pid: 6578 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.870621:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787114994.870637:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787114994.870643:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c86a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.870653:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c86a7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.870751:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787114994.870778:0:6577:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c86a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.870792:0:6577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c86a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.870820:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c86a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.870830:0:6577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c86a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.870838:0:6577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c86a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.870847:0:6577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2200 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787114994.870852:0:6577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c86a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.870861:0:6577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c86a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.870878:0:6577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c86a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114994.870892:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f961f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2363:x1873925602572288:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 619us (7531us total) trans 0 rc 0/0 00010000:00010000:0.0:1787114994.870906:0:6577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c86a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114994.870921:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 36 00000100:00100000:0.0:1787114994.870976:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2363:x1873925602572032:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 50423us (50728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114994.870984:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 23 00000100:00100000:0.0:1787114994.888540:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114994.890506:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602572544 00000100:00100000:1.0:1787114994.890522:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602572544 00000100:00100000:1.0:1787114994.890591:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:1.0:1787114994.890602:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+20:10284:x1873925602572544:12345-192.168.202.10@tcp:35:lfs.0 00000004:00010000:1.0:1787114994.890669:0:5789:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8699 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14a2 expref: 20 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787114994.890998:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1787114994.891066:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1787114994.891795:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1787114994.891955:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c86ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.891985:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c863e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1478 expref: 24 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.891996:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c86ae lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.892056:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c863e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1478 expref: 24 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114994.892073:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c863e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1478 expref: 24 pid: 5787 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114994.892158:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f961180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5789:1873925624626432:192.168.202.10@tcp:104: 00000100:00100000:1.0:1787114994.892342:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af07b83fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787114994.904667:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114994.904882:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602572672 00000100:00100000:2.0:1787114994.904892:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602572672 00010000:00010000:2.0:1787114994.904957:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c863e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1478 expref: 25 pid: 5787 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114994.905064:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 37 00000100:00100000:2.0:1787114994.905074:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+25:2364:x1873925602572672:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787114994.905213:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787114994.905221:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c863e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1478 expref: 25 pid: 5787 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.905236:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c863e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1478 expref: 25 pid: 5787 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.905601:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0510d6700) 00010000:00010000:2.0:1787114994.905607:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c86ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.905617:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c86ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.905624:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c86ae lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114994.905644:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787114994.905789:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c863e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1478 expref: 25 pid: 5787 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114994.905807:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f961180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5789:1873925624626432:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787114994.905836:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c86ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114994.905845:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c86ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114994.905852:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c86ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787114994.905981:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000100:00100000:2.0:1787114994.906181:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+25:2364:x1873925602572672:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1107us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114994.906190:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 37 00000001:00080000:3.0:1787114994.907100:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1787114994.919845:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7bce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1873925624626560:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787114994.919954:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114994.919984:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045be16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787114994.920025:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624626560 00000100:00100000:3.0:1787114994.920032:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624626560 00000100:00100000:3.0:1787114994.920102:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787114994.920134:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5789:x1873925624626560:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787114994.921566:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5789:x1873925624626560:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1430us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114994.921578:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787114994.921825:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7bce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1873925624626560:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787114994.927606:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1787114994.927708:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7bce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1873925624626688:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787114994.927778:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114994.927810:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045be1780 going to sleep for 11 seconds 00000100:00100000:3.0:1787114994.927841:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624626688 00000100:00100000:3.0:1787114994.927848:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624626688 00000100:00100000:3.0:1787114994.927895:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787114994.927904:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5789:x1873925624626688:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787114994.929990:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5789:x1873925624626688:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 175us (300us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787114994.930004:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787114994.930210:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7bce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1873925624626688:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787114994.930349:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1787114994.930405:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c86ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114994.930416:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c86ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114994.930423:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c86ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114994.930430:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787114994.930435:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c86ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114994.930442:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c86ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114994.930458:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0510d6700) 00010000:00010000:3.0:1787114994.930461:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787114994.930466:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c86ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114994.930472:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c86ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787114994.930680:0:5789:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787114994.933411:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1787114994.933435:0:5789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 323919326932ns, next at 324919322535ns, rc = 0 00000001:00080000:3.0:1787114994.933452:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1787114994.933516:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0510d6700) 00010000:00010000:3.0:1787114994.933521:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787114994.933531:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8699 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14a2 expref: 28 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114994.933665:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+27:10284:x1873925602572544:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 43063us (45146us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787114994.933675:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8 00000020:00080000:3.0:1787114994.933680:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787114994.942411:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114994.942509:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602572800 00000100:00100000:0.0:1787114994.942519:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602572800 00000100:00100000:0.0:1787114994.942583:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 45 00000100:00100000:0.0:1787114994.942593:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+27:10284:x1873925602572800:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1787114994.942616:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114994.942639:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c86b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d14a9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.942700:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c86b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14a9 expref: 28 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.942715:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c86b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14a9 expref: 28 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114994.942735:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:0.0:1787114994.942739:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787114994.942743:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052364800, rc 0) 00000100:00100000:0.0:1787114994.942809:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+28:10284:x1873925602572800:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 217us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114994.942830:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 45 00000100:00100000:0.0:1787114994.951227:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114994.951471:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602573056 00000100:00100000:3.0:1787114994.951483:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602573056 00000100:00100000:3.0:1787114994.951537:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00100000:3.0:1787114994.951547:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af066349850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+28:10284:x1873925602573056:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:3.0:1787114994.951821:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af066349850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+29:10284:x1873925602573056:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 274us (603us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1787114994.951828:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 9 00010000:00010000:0.0:1787114995.015656:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787114995.086000:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06ef7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624626816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787114995.086099:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114995.094797:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624626816 00000100:00100000:1.0:1787114995.094811:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624626816 00000100:00100000:1.0:1787114995.094911:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787114995.094923:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624626816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787114995.094983:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787114995.095169:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624626816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 229us (9050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114995.095176:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787114995.096770:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06ef7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624626816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787114995.127692:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114995.127722:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602573312 00000100:00100000:2.0:1787114995.127730:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602573312 00000100:00100000:2.0:1787114995.127768:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 46 00000100:00100000:2.0:1787114995.127782:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+29:10294:x1873925602573312:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1787114995.127803:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114995.127819:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c86bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d14b0 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787114995.128003:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787114995.129566:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c86bc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14b0 expref: 31 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.129583:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0514c6c00) 00010000:00010000:2.0:1787114995.129586:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787114995.129590:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c86bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14b0 expref: 31 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.129602:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2a00, rc 0) 00000100:00100000:2.0:1787114995.129666:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+30:10294:x1873925602573312:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1885us (1983us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1787114995.129672:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 46 00000100:00100000:1.0:1787114995.135619:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114995.135694:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602573440 00000100:00100000:0.0:1787114995.135704:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602573440 00000100:00100000:0.0:1787114995.135761:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 47 00000100:00100000:0.0:1787114995.135772:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+30:10294:x1873925602573440:12345-192.168.202.10@tcp:34:lfs.0 00010000:00010000:0.0:1787114995.135841:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c86ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.135939:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c86ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.135949:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c86ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.135960:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c86d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.135964:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c86d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.135968:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c86d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136473:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c86d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136482:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c86d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136501:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c86d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787114995.136543:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c86d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136555:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c86ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136561:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c86ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136568:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c86ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136574:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052365000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114995.136578:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c86ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136586:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c86ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136598:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:0.0:1787114995.136602:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114995.136607:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c86ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136613:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c86ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136623:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c86d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136632:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c86d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136636:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c86d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136638:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114995.136640:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c86d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136644:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c86d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136649:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8af051ecb300) 00010000:00010000:0.0:1787114995.136650:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114995.136652:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c86d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136655:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c86d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136665:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c86d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136668:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c86d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136672:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c86d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136674:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114995.136679:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c86d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136683:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c86d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136687:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:0.0:1787114995.136688:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114995.136690:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c86d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.136693:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c86d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114995.136970:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+30:10294:x1873925602573440:12345-192.168.202.10@tcp:34:lfs.0 Request processed in 1198us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114995.136978:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 47 00000100:00100000:3.0:1787114995.142293:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114995.142326:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602573696 00000100:00100000:3.0:1787114995.142334:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602573696 00000100:00100000:3.0:1787114995.142382:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 10 00000100:00100000:3.0:1787114995.142391:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+30:10294:x1873925602573696:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:3.0:1787114995.142751:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+31:10294:x1873925602573696:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 359us (466us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787114995.142764:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 10 00000001:00080000:2.0:1787114995.157591:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967313 is committed 00000001:00080000:2.0:1787114995.157723:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967320 is committed 00000001:00080000:2.0:1787114995.158036:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967326 is committed 00000004:00080000:2.0:1787114995.158047:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787114995.158687:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06ef78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624626944:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787114995.158764:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114995.158932:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624626944 00000100:00100000:1.0:1787114995.158940:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624626944 00000100:00100000:1.0:1787114995.158993:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787114995.159003:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1873925624626944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787114995.159030:0:6576:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1787114995.159062:0:6576:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8535f3, atime: 0x6a8535f3, ctime: 0x6a8535f3, blocks: 0x1 00010000:00010000:1.0:1787114995.159070:0:6576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d215abca/0x194cd781e88c86df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.159099:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=324s v=(0 0) 00010000:00010000:1.0:1787114995.159104:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787114995.159126:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d215abca/0x194cd781e88c86df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.159142:0:6576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d215abca/0x194cd781e88c86df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.159168:0:6576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d215abca/0x194cd781e88c86df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.159176:0:6576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d215abca/0x194cd781e88c86df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.159211:0:6576:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787114995.161503:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1873925624626944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2495us (2732us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787114995.161517:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787114995.161556:0:8291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787114995.161563:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d215abca/0x194cd781e88c86df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.161577:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1800 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:1.0:1787114995.161581:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d215abca/0x194cd781e88c86df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.161592:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d215abca/0x194cd781e88c86df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.161611:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d215abca/0x194cd781e88c86df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.161620:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d215abca/0x194cd781e88c86df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.161643:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114995.161646:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787114995.161647:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787114995.161686:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8af06ef78a80/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787114995.161693:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06ef78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624626944:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1787114995.162853:0:5807:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8af045be16c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787114995.162862:0:5807:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af050f52700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8af045be1600 00000020:00080000:2.0:1787114995.162865:0:5807:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af050f52b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af07f727000 00000020:00080000:1.0:1787114995.164052:0:5818:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1787114995.164720:0:5818:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1787114995.188443:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114995.188541:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602573952 00000100:00100000:2.0:1787114995.188560:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602573952 00000100:00100000:2.0:1787114995.188614:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 48 00000100:00100000:2.0:1787114995.188625:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+13:10298:x1873925602573952:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1787114995.188651:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114995.188675:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c86e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d14b7 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.188743:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c86ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.188755:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c86ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.188763:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c86ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.188773:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c86f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.188777:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c86f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.188781:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c86f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.189102:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c86fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.189444:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c86fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.189453:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c86fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787114995.189471:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787114995.189681:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c86ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114995.189690:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c86ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114995.189697:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c86ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114995.189703:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787114995.189707:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c86ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114995.189715:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c86ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114995.189728:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:3.0:1787114995.189731:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787114995.189735:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c86ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114995.189741:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c86ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114995.189754:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c86f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114995.189771:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c86f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114995.189777:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c86f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114995.189783:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787114995.189786:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c86f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114995.189793:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c86f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114995.189801:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8af0514c6100) 00010000:00010000:3.0:1787114995.189804:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787114995.189807:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c86f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114995.189813:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c86f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114995.189859:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c86e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14b7 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114995.189874:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c86fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14b7 expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114995.189882:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:3.0:1787114995.189885:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787114995.189894:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2400, rc 0) 00000100:00100000:3.0:1787114995.190024:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+15:10298:x1873925602573952:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1400us (1587us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1787114995.190033:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 48 00000100:00100000:3.0:1787114995.195393:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114995.195509:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602574080 00000100:00100000:1.0:1787114995.195518:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602574080 00000100:00100000:1.0:1787114995.195598:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 49 00000100:00100000:1.0:1787114995.195606:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+15:10298:x1873925602574080:12345-192.168.202.10@tcp:54:lfs.0 00010000:00010000:1.0:1787114995.195666:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8709 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.195680:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.195688:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.195709:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.195714:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8709 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.195718:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8709 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.195722:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1a00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787114995.195725:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8709 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.195729:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8709 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.195753:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:1.0:1787114995.195755:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787114995.195759:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8709 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.195763:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8709 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114995.195821:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+15:10298:x1873925602574080:12345-192.168.202.10@tcp:54:lfs.0 Request processed in 215us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114995.195825:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 49 00000100:00100000:1.0:1787114995.197439:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114995.197478:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602574336 00000100:00100000:3.0:1787114995.197484:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602574336 00000100:00100000:3.0:1787114995.197548:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00100000:3.0:1787114995.197555:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+15:10298:x1873925602574336:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:3.0:1787114995.197717:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+16:10298:x1873925602574336:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 162us (283us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1787114995.197725:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00100000:3.0:1787114995.585291:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114995.585460:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602574592 00000100:00100000:0.0:1787114995.585470:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602574592 00000100:00100000:0.0:1787114995.585536:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 50 00000100:00100000:0.0:1787114995.585546:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+16:10329:x1873925602574592:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1787114995.585569:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114995.585590:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8710 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d14be expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.585680:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8717 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.585694:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.585722:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787114995.585734:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787114995.585879:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8710 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14be expref: 19 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.585898:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8717 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14be expref: 18 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.585906:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:0.0:1787114995.585909:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787114995.585913:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052364400, rc 0) 00000100:00100000:0.0:1787114995.585978:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:10329:x1873925602574592:12345-192.168.202.10@tcp:101:cat.0 Request processed in 432us (696us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1787114995.585984:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 50 00000100:00100000:0.0:1787114995.599333:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114995.599524:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114995.599597:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602574976 00000100:00100000:1.0:1787114995.599608:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602574976 00000100:00100000:1.0:1787114995.599689:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 3 00000100:00100000:1.0:1787114995.599701:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:2364:x1873925602574976:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787114995.599719:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787114995.599748:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8717 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14be expref: 18 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.599771:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:1.0:1787114995.599777:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787114995.599857:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+17:2364:x1873925602574976:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 149us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114995.599864:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 3 00000100:00100000:3.0:1787114995.605022:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602574848 00000100:00100000:3.0:1787114995.605039:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602574848 00000100:00100000:3.0:1787114995.605220:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12 00000100:00100000:3.0:1787114995.605231:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+17:10329:x1873925602574848:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:3.0:1787114995.605539:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:10329:x1873925602574848:12345-192.168.202.10@tcp:35:cat.0 Request processed in 307us (7478us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1787114995.605547:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12 00000100:00100000:0.0:1787114995.677469:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114995.677656:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602575232 00000100:00100000:1.0:1787114995.677665:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602575232 00000100:00100000:1.0:1787114995.677745:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 51 00000100:00100000:1.0:1787114995.677756:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:10335:x1873925602575232:12345-192.168.202.10@tcp:101:dd.0 00010000:00010000:1.0:1787114995.677783:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787114995.677787:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787114995.677813:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c8676 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1494 expref: 18 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.677834:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:1.0:1787114995.677840:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787114995.677857:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c8725 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d14c5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.677963:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c872c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.677978:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c86fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14b7 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.677986:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c872c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.678021:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c86fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14b7 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114995.678034:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c86fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14b7 expref: 18 pid: 5785 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114995.678050:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06ef79c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624627072:192.168.202.10@tcp:104: 00000100:00100000:1.0:1787114995.678265:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af07b83fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787114995.684719:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06ef79c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624627072:192.168.202.10@tcp:104: 00010000:00010000:0.0:1787114995.684753:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c872c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114995.685744:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114995.685917:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602575360 00000100:00100000:2.0:1787114995.685926:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602575360 00010000:00010000:2.0:1787114995.685963:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c86fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14b7 expref: 19 pid: 5785 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114995.686001:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 38 00000100:00100000:2.0:1787114995.686010:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+19:2364:x1873925602575360:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787114995.686024:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787114995.686030:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c86fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14b7 expref: 19 pid: 5785 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.686043:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c86fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14b7 expref: 19 pid: 5785 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.686066:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c86fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14b7 expref: 19 pid: 5785 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.686094:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:2.0:1787114995.686099:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c872c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.686172:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c872c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.686181:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c872c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.686216:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787114995.686286:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:2364:x1873925602575360:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 275us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114995.686293:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 38 00010000:00010000:0.0:1787114995.688030:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c872c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.688101:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c872c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787114995.688556:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787114995.688725:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c8725 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14c5 expref: 19 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.688745:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c872c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14c5 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114995.688754:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:0.0:1787114995.688757:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787114995.688760:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0a00, rc 0) 00000100:00100000:0.0:1787114995.688828:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:10335:x1873925602575232:12345-192.168.202.10@tcp:101:dd.0 Request processed in 11073us (11372us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787114995.688836:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 51 00000100:00100000:0.0:1787114995.695685:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114995.695815:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602575616 00000100:00100000:2.0:1787114995.695828:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602575616 00000100:00100000:2.0:1787114995.695901:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 52 00000100:00100000:2.0:1787114995.695913:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:10335:x1873925602575616:12345-192.168.202.10@tcp:36:dd.0 00010000:00010000:2.0:1787114995.696277:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c873a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.696296:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c873a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.696309:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c873a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787114995.696367:0:7216:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1787114995.696394:0:7216:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005fc081a2 reply state 000000002b54e675 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c873a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114995.696403:0:7216:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787114995.696511:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+21:10335:x1873925602575616:12345-192.168.202.10@tcp:36:dd.0 Request processed in 599us (835us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787114995.696519:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 52 00000020:00080000:2.0:1787114995.696524:0:7216:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787114995.699101:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c873a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.699285:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c873a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.699293:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c873a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.699299:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787114995.699304:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c873a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.699313:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c873a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.699331:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:2.0:1787114995.699334:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787114995.699339:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c873a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114995.699345:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c873a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.037379:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114996.087629:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114996.087723:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602575744 00000100:00100000:2.0:1787114996.087733:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602575744 00000100:00100000:2.0:1787114996.087808:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 53 00000100:00100000:2.0:1787114996.087819:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+20:10349:x1873925602575744:12345-192.168.202.10@tcp:101:stat.0 00010000:00010000:2.0:1787114996.087843:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114996.087865:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c8741 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d14cc expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787114996.088751:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787114996.089502:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c8748 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.089523:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c8748 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.089535:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c8748 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.089551:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c874f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.089558:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c874f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.089564:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c874f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.089902:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8756 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.089915:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c872c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14c5 expref: 21 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.089923:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8756 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.089956:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c872c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14c5 expref: 21 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.089982:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c872c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14c5 expref: 21 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114996.089997:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b6a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1873925624627200:192.168.202.10@tcp:104: 00000100:00100000:2.0:1787114996.090472:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5f0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787114996.097205:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114996.097644:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602576000 00000100:00100000:3.0:1787114996.097655:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602576000 00000100:00100000:3.0:1787114996.097713:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:3.0:1787114996.097723:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+22:5577:x1873925602576000:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787114996.098083:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+23:5577:x1873925602576000:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 360us (887us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1787114996.098104:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:2.0:1787114996.098735:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b6a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1873925624627200:192.168.202.10@tcp:104: 00010000:00010000:2.0:1787114996.098763:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8756 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114996.100917:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114996.100945:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602576128 00000100:00100000:1.0:1787114996.100952:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602576128 00010000:00010000:1.0:1787114996.100982:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c872c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14c5 expref: 23 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114996.101006:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 39 00000100:00100000:1.0:1787114996.101011:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+23:2364:x1873925602576128:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787114996.101022:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787114996.101033:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c872c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14c5 expref: 23 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114996.101051:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c872c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14c5 expref: 23 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114996.101086:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c872c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14c5 expref: 23 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114996.101104:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:1.0:1787114996.101148:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8756 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114996.101156:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114996.101161:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8756 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114996.101192:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787114996.101226:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+22:2364:x1873925602576128:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 214us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114996.101240:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 39 00010000:00010000:2.0:1787114996.101936:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.101947:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787114996.102000:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787114996.102005:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787114996.102055:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.102078:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.102088:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c8748 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.102094:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c8748 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.102161:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c8748 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.102168:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787114996.102172:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c8748 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.102180:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c8748 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.102193:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:2.0:1787114996.102196:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787114996.102200:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c8748 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.102206:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c8748 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.102220:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c874f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.102226:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c874f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.102241:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c874f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.102246:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3a00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787114996.102249:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c874f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.102268:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c874f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.102276:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8af0514c6a00) 00010000:00010000:2.0:1787114996.102279:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787114996.102282:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c874f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.102288:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c874f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.102328:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c8741 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14cc expref: 22 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.102342:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8756 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14cc expref: 21 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.102350:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:2.0:1787114996.102353:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787114996.102356:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2a00, rc 0) 00000100:00100000:2.0:1787114996.102410:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+21:10349:x1873925602575744:12345-192.168.202.10@tcp:101:stat.0 Request processed in 14593us (14790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114996.102420:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 53 00000100:00100000:1.0:1787114996.230764:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114996.230873:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602576384 00000100:00100000:2.0:1787114996.230883:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602576384 00000100:00100000:2.0:1787114996.230944:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 54 00000100:00100000:2.0:1787114996.230956:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+21:10355:x1873925602576384:12345-192.168.202.10@tcp:36:truncate.0 00010000:00010000:2.0:1787114996.231024:0:7216:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787114996.231050:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8756 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14cc expref: 21 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.231079:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:2.0:1787114996.231085:0:7216:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787114996.231577:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c875d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.231592:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c875d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.231602:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c875d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787114996.231649:0:7216:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1787114996.231674:0:7216:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003bcc5bcc reply state 0000000020f836b3 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c875d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114996.231682:0:7216:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787114996.231786:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+23:10355:x1873925602576384:12345-192.168.202.10@tcp:36:truncate.0 Request processed in 832us (1031us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787114996.231795:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 54 00000020:00080000:2.0:1787114996.231800:0:7216:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787114996.236456:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c875d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114996.236474:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c875d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114996.236686:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c875d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114996.236693:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787114996.236697:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c875d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114996.236706:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c875d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114996.236735:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:3.0:1787114996.236739:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787114996.236744:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c875d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114996.236749:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c875d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787114996.421661:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787114996.501557:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114996.501928:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602576512 00000100:00100000:0.0:1787114996.501938:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602576512 00000100:00100000:0.0:1787114996.502002:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 55 00000100:00100000:0.0:1787114996.502009:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+22:10369:x1873925602576512:12345-192.168.202.10@tcp:101:stat.0 00010000:00010000:0.0:1787114996.502032:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114996.502050:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8764 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d14d3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.502186:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c876b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.502202:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c876b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.502214:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c876b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.502241:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8772 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.502254:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.502259:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.502662:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8779 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.502673:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.502680:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787114996.502726:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787114996.502730:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787114996.502752:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.502770:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.502776:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c876b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.502781:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c876b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.502785:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c876b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.502789:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052365000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114996.502792:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c876b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.502797:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c876b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.502804:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:0.0:1787114996.502807:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114996.502810:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c876b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.502969:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365000/0x194cd781e88c876b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.502979:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.502983:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8772 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.502992:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.502995:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114996.502997:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.503000:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8772 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.503005:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8af051ecb300) 00010000:00010000:0.0:1787114996.503007:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114996.503008:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8772 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.503012:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364c00/0x194cd781e88c8772 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.503037:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364400/0x194cd781e88c8764 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14d3 expref: 24 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.503045:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8779 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14d3 expref: 23 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.503050:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:0.0:1787114996.503052:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787114996.503054:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040031600, rc 0) 00000100:00100000:0.0:1787114996.503464:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+23:10369:x1873925602576512:12345-192.168.202.10@tcp:101:stat.0 Request processed in 1452us (1917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114996.503551:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 55 00000100:00100000:3.0:1787114996.621389:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114996.621551:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602576768 00000100:00100000:2.0:1787114996.621563:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602576768 00000100:00100000:2.0:1787114996.621633:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 56 00000100:00100000:2.0:1787114996.621644:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+23:10379:x1873925602576768:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1787114996.621683:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114996.621717:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8780 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d14da expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787114996.622176:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787114996.622552:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8780 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14da expref: 25 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.622568:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0514c6c00) 00010000:00010000:2.0:1787114996.622571:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787114996.622577:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8780 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14da expref: 25 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.622590:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2a00, rc 0) 00000100:00100000:2.0:1787114996.622714:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+24:10379:x1873925602576768:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1071us (1334us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1787114996.622722:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 56 00000100:00100000:3.0:1787114996.636597:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114996.636678:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602577024 00000100:00100000:0.0:1787114996.636687:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602577024 00000100:00100000:0.0:1787114996.636735:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 14 00000100:00100000:0.0:1787114996.636742:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+24:10379:x1873925602577024:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:0.0:1787114996.637410:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+25:10379:x1873925602577024:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 666us (823us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1787114996.637417:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 14 00000100:00100000:1.0:1787114996.748283:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114996.748496:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602577280 00000100:00100000:0.0:1787114996.748513:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602577280 00000100:00100000:0.0:1787114996.748566:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 57 00000100:00100000:0.0:1787114996.748574:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+25:10385:x1873925602577280:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:0.0:1787114996.748594:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114996.748612:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c878e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d14e1 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.748721:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8795 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.748736:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8779 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14d3 expref: 26 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.748745:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8795 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.748777:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8779 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14d3 expref: 26 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.748801:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8779 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14d3 expref: 26 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114996.748819:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624627328:192.168.202.10@tcp:104: 00000100:00100000:0.0:1787114996.748918:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af044f4a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787114996.757603:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114996.759074:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602577408 00000100:00100000:2.0:1787114996.759087:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602577408 00010000:00010000:2.0:1787114996.759184:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8779 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14d3 expref: 27 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114996.759240:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 40 00000100:00100000:2.0:1787114996.759251:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+27:2364:x1873925602577408:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787114996.759267:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787114996.759275:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8779 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14d3 expref: 27 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.759306:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8779 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14d3 expref: 27 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.759327:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:2.0:1787114996.759333:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8795 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.759343:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8795 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.759351:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8795 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.759369:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787114996.759428:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+27:2364:x1873925602577408:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 179us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114996.759435:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 40 00010000:00010000:0.0:1787114996.760638:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8779 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14d3 expref: 26 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114996.760661:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624627328:192.168.202.10@tcp:104: 00010000:00010000:0.0:1787114996.760687:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8795 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.760711:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8795 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.760718:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8795 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787114996.760745:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787114996.760912:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c878e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14e1 expref: 27 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.760924:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8795 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14e1 expref: 26 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114996.760931:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:0.0:1787114996.760942:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787114996.760945:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040031000, rc 0) 00000100:00100000:0.0:1787114996.760995:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+26:10385:x1873925602577280:12345-192.168.202.10@tcp:101:bash.0 Request processed in 12422us (12719us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1787114996.761000:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 57 00000100:00100000:1.0:1787114996.769495:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114996.769728:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602577664 00000100:00100000:0.0:1787114996.769739:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602577664 00000100:00100000:0.0:1787114996.769801:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 58 00000100:00100000:0.0:1787114996.769813:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+26:10385:x1873925602577664:12345-192.168.202.10@tcp:36:bash.0 00010000:00010000:1.0:1787114996.770502:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c87a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114996.770518:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c87a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114996.770527:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c87a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787114996.770569:0:7216:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1787114996.770615:0:7216:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000062d59316 reply state 00000000d4bb85e4 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c87a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114996.770622:0:7216:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787114996.770729:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+29:10385:x1873925602577664:12345-192.168.202.10@tcp:36:bash.0 Request processed in 917us (1242us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1787114996.770737:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 58 00000020:00080000:1.0:1787114996.770742:0:7216:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787114996.772508:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c87a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.772523:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c87a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.772530:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c87a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.772536:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787114996.772541:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c87a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.772564:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c87a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.772578:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:2.0:1787114996.772581:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787114996.772585:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c87a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.772590:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c87a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114996.797650:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114996.797975:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602577792 00000100:00100000:2.0:1787114996.797987:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602577792 00000100:00100000:2.0:1787114996.798081:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 59 00000100:00100000:2.0:1787114996.798091:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+28:10385:x1873925602577792:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:2.0:1787114996.798167:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114996.798202:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c87aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d14e8 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.798325:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c87b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.798341:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8795 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14e1 expref: 29 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.798350:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c87b1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.798397:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8795 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14e1 expref: 29 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.798417:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8795 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14e1 expref: 29 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114996.798433:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b6a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1873925624627456:192.168.202.10@tcp:104: 00000100:00100000:2.0:1787114996.798533:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5f0600 going to sleep for 11 seconds 00000100:00100000:2.0:1787114996.801231:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b6a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1873925624627456:192.168.202.10@tcp:104: 00000100:00100000:1.0:1787114996.801240:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1787114996.801256:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c87b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114996.801398:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602577920 00000100:00100000:3.0:1787114996.801406:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602577920 00010000:00010000:3.0:1787114996.801442:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8795 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14e1 expref: 30 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114996.801494:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 41 00000100:00100000:3.0:1787114996.801504:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+30:2364:x1873925602577920:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787114996.801518:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787114996.801525:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8795 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14e1 expref: 30 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114996.801536:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8795 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14e1 expref: 30 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114996.801563:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8795 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14e1 expref: 30 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114996.801583:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:3.0:1787114996.801589:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c87b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114996.801598:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c87b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114996.801608:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c87b1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114996.801638:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787114996.801682:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c87b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.801691:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c87b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114996.801696:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+29:2364:x1873925602577920:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 191us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114996.801709:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 41 00000004:00200000:2.0:1787114996.801745:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787114996.801750:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787114996.801777:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c87b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.801806:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c87aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14e8 expref: 29 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.801822:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c87b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14e8 expref: 28 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114996.801830:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:2.0:1787114996.801839:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787114996.801842:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3a00, rc 0) 00000100:00100000:2.0:1787114996.801869:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+28:10385:x1873925602577792:12345-192.168.202.10@tcp:101:bash.0 Request processed in 3781us (4233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114996.801877:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 59 00000100:00100000:3.0:1787114996.811904:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114996.812158:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602578176 00000100:00100000:0.0:1787114996.812172:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602578176 00000100:00100000:0.0:1787114996.812259:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15 00000100:00100000:0.0:1787114996.812271:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06634b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+28:10385:x1873925602578176:12345-192.168.202.10@tcp:35:bash.0 00000100:00100000:0.0:1787114996.812544:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06634b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+29:10385:x1873925602578176:12345-192.168.202.10@tcp:35:bash.0 Request processed in 275us (648us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1787114996.812553:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15 00000100:00100000:1.0:1787114997.007697:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114997.007878:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602578432 00000100:00100000:2.0:1787114997.007892:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602578432 00000100:00100000:2.0:1787114997.007961:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 60 00000100:00100000:2.0:1787114997.007969:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+29:10395:x1873925602578432:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1787114997.008000:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114997.008022:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c87b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d14ef expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787114997.008601:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787114997.008762:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c87b8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14ef expref: 31 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.008774:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0514c6c00) 00010000:00010000:2.0:1787114997.008776:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787114997.008779:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c87b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14ef expref: 31 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.008789:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2a00, rc 0) 00000100:00100000:2.0:1787114997.008860:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+30:10395:x1873925602578432:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 892us (1178us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787114997.008866:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 60 00000100:00100000:1.0:1787114997.016195:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114997.016294:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602578560 00000100:00100000:0.0:1787114997.016306:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602578560 00000100:00100000:0.0:1787114997.016367:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 61 00000100:00100000:0.0:1787114997.016379:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+30:10395:x1873925602578560:12345-192.168.202.10@tcp:34:lfs.0 00010000:00010000:0.0:1787114997.016458:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c87c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.016486:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c87c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.016501:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c87c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.016530:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c87cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.016537:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c87cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.016543:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c87cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.016906:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c87d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.016917:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c87d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.016925:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c87d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787114997.016974:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c87d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.016986:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c87c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.016993:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c87c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.017000:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c87c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.017007:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040031600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114997.017011:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c87c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.017027:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c87c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.017038:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:0.0:1787114997.017041:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114997.017045:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c87c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.017051:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c87c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.017076:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c87cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.017082:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c87cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.017087:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c87cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.017093:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114997.017095:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c87cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.017101:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c87cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.017158:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8af051ecb300) 00010000:00010000:0.0:1787114997.017161:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114997.017164:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c87cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.017179:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c87cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.017195:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c87d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.017202:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c87d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.017207:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c87d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.017211:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114997.017214:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c87d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.017220:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c87d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.017228:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:0.0:1787114997.017230:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114997.017233:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c87d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.017238:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c87d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114997.017323:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+30:10395:x1873925602578560:12345-192.168.202.10@tcp:34:lfs.0 Request processed in 946us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114997.017331:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 61 00000100:00100000:3.0:1787114997.036039:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114997.036393:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602578816 00000100:00100000:0.0:1787114997.036405:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602578816 00000100:00100000:0.0:1787114997.036477:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16 00000100:00100000:0.0:1787114997.036488:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+30:10395:x1873925602578816:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:0.0:1787114997.037443:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+31:10395:x1873925602578816:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 952us (1412us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787114997.037456:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16 00010000:00010000:3.0:1787114997.062504:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787114997.121424:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114997.121496:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602579072 00000100:00100000:2.0:1787114997.121523:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602579072 00000100:00100000:2.0:1787114997.121631:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 62 00000100:00100000:2.0:1787114997.121642:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+31:10398:x1873925602579072:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1787114997.121669:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114997.121694:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c87db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d14f6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.121768:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c87e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.121782:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c87e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.121793:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c87e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.121809:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c87e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.121817:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c87e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.121823:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c87e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.122272:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c87f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.122284:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c87f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.122292:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c87f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787114997.122309:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787114997.122404:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c87e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.122412:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c87e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.122418:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c87e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.122425:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787114997.122429:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c87e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.122437:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c87e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.122449:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:2.0:1787114997.122453:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787114997.122457:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c87e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.122463:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c87e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.122475:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c87e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.122480:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c87e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.122495:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c87e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.122500:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787114997.122503:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c87e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.122509:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c87e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.122517:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8af0514c6a00) 00010000:00010000:2.0:1787114997.122519:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787114997.122521:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c87e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.122526:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c87e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.122569:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c87db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14f6 expref: 34 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.122582:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c87f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14f6 expref: 33 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.122589:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:2.0:1787114997.122591:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787114997.122594:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2e00, rc 0) 00000100:00100000:2.0:1787114997.122726:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+33:10398:x1873925602579072:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1085us (1313us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1787114997.122742:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 62 00000100:00100000:1.0:1787114997.140635:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114997.140680:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114997.140767:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602579328 00000100:00100000:0.0:1787114997.140777:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602579328 00000100:00100000:0.0:1787114997.140843:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 63 00000100:00100000:0.0:1787114997.140853:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+33:10398:x1873925602579328:12345-192.168.202.10@tcp:54:lfs.0 00010000:00010000:0.0:1787114997.140925:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c87fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.140943:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c87fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.140954:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c87fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.140982:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c87fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.140989:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c87fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.140995:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c87fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.141002:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114997.141020:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c87fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.141028:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c87fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.141041:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:0.0:1787114997.141044:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787114997.141048:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c87fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.141065:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c87fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114997.141188:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+33:10398:x1873925602579328:12345-192.168.202.10@tcp:54:lfs.0 Request processed in 335us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114997.141195:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 63 00000100:00100000:2.0:1787114997.141541:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602579200 00000100:00100000:2.0:1787114997.141547:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602579200 00000100:00100000:2.0:1787114997.141585:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4 00000100:00100000:2.0:1787114997.141592:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+33:2364:x1873925602579200:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787114997.141603:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787114997.141617:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c87f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14f6 expref: 33 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.141628:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:2.0:1787114997.141632:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787114997.141661:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+32:2364:x1873925602579200:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 69us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114997.141667:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4 00000100:00100000:1.0:1787114997.144440:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114997.144540:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602579584 00000100:00100000:3.0:1787114997.144550:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602579584 00000100:00100000:3.0:1787114997.144603:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17 00000100:00100000:3.0:1787114997.144613:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+32:10398:x1873925602579584:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:3.0:1787114997.145011:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+33:10398:x1873925602579584:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 399us (580us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1787114997.145019:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17 00000100:00100000:1.0:1787114997.387136:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114997.389502:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602579840 00000100:00100000:2.0:1787114997.389520:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602579840 00000100:00100000:3.0:1787114997.389633:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 64 00000100:00100000:3.0:1787114997.389643:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+33:10416:x1873925602579840:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1787114997.389667:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787114997.389688:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c8805 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d14fd expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114997.389793:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c880c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114997.389808:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c880c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114997.389821:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c880c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787114997.389844:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787114997.389961:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c8805 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14fd expref: 36 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114997.390000:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c880c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14fd expref: 35 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114997.390009:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:3.0:1787114997.390011:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787114997.390015:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429cbe00, rc 0) 00000100:00100000:3.0:1787114997.390104:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+35:10416:x1873925602579840:12345-192.168.202.10@tcp:101:cat.0 Request processed in 461us (3003us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1787114997.390286:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 64 00000100:00100000:0.0:1787114997.441624:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114997.441766:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602579968 00000100:00100000:1.0:1787114997.441776:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602579968 00000100:00100000:1.0:1787114997.441849:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 65 00000100:00100000:1.0:1787114997.441859:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+35:10417:x1873925602579968:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1787114997.441884:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787114997.441905:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c881a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1504 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114997.441971:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8821 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114997.442000:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114997.442029:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787114997.442357:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787114997.442362:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787114997.442444:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114997.442486:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c881a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1504 expref: 37 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114997.442518:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8821 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1504 expref: 36 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114997.442527:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:1.0:1787114997.442530:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787114997.442534:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0c00, rc 0) 00000100:00100000:1.0:1787114997.442626:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+36:10417:x1873925602579968:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 767us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114997.442634:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 65 00000100:00100000:1.0:1787114997.454152:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114997.454257:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602580352 00000100:00100000:0.0:1787114997.454268:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602580352 00000100:00100000:0.0:1787114997.454331:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 18 00000100:00100000:0.0:1787114997.454344:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+36:10417:x1873925602580352:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:0.0:1787114997.454708:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+37:10417:x1873925602580352:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 365us (563us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787114997.454716:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 18 00000100:00100000:2.0:1787114997.457299:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114997.458765:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602580480 00000100:00100000:0.0:1787114997.458779:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602580480 00000100:00100000:0.0:1787114997.458878:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5 00000100:00100000:0.0:1787114997.458890:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+37:10417:x1873925602580480:12345-192.168.202.10@tcp:103:lfs.0 00010000:00010000:0.0:1787114997.458930:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787114997.458957:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c87b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14e8 expref: 37 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.458983:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c880c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14fd expref: 36 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.458997:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c86b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d14a9 expref: 35 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.459008:0:6592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb600) 00010000:00010000:0.0:1787114997.459019:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787114997.459838:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+34:10417:x1873925602580480:12345-192.168.202.10@tcp:103:lfs.0 Request processed in 938us (2535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114997.459848:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5 00000100:00100000:1.0:1787114997.477681:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114997.477771:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602580608 00000100:00100000:2.0:1787114997.477781:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602580608 00000100:00100000:2.0:1787114997.477858:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 66 00000100:00100000:2.0:1787114997.477868:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+34:10417:x1873925602580608:12345-192.168.202.10@tcp:58:lfs.0 00010000:00010000:2.0:1787114997.478003:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8828 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.478020:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8828 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114997.478043:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8828 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787114997.478814:0:7216:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787114997.479039:0:7216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787114997.479136:0:7216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787114997.480610:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+34:10417:x1873925602580608:12345-192.168.202.10@tcp:58:lfs.0 Request processed in 2735us (2930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114997.480621:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 66 00000100:00100000:1.0:1787114997.531770:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114997.531934:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602580736 00000100:00100000:0.0:1787114997.531945:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602580736 00000100:00100000:0.0:1787114997.532016:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 67 00000100:00100000:0.0:1787114997.532027:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+34:10419:x1873925602580736:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1787114997.532048:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114997.532097:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c882f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d150b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.532205:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8836 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.532408:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8836 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.532434:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8836 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.532461:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c883d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.532468:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c883d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.532474:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c883d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.533814:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8844 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.533918:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.533930:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787114997.533972:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787114997.533976:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787114997.533997:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.534009:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.534019:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8836 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.534046:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8836 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.534064:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8836 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.534070:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040031600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114997.534076:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8836 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.534083:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8836 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.534139:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:0.0:1787114997.534143:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114997.534149:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8836 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.534156:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8836 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.535149:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c883d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.535158:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c883d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.535777:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c883d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.535784:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787114997.535813:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c883d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.535821:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c883d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.535843:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8af051ecb600) 00010000:00010000:0.0:1787114997.535847:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787114997.535851:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c883d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.535857:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c883d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.535908:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c882f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d150b expref: 36 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.535921:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8844 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d150b expref: 35 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114997.535928:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0514c6a00) 00010000:00010000:0.0:1787114997.535930:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787114997.535932:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030a00, rc 0) 00000100:00100000:0.0:1787114997.536013:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+35:10419:x1873925602580736:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 3987us (4251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114997.536022:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 67 00010000:00010000:0.0:1787114998.085225:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787114998.471786:0:11519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787114998.471795:0:11519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787114998.471851:0:11519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787114998.471859:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787114998.471992:0:11519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7bf800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11519:1873925624627584:192.168.202.10@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787114998.475420:0:11519:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045be1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787114998.487351:0:11519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7bf800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11519:1873925624627584:192.168.202.10@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787114998.493378:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114998.493642:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602580864 00000100:00100000:2.0:1787114998.493654:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602580864 00000100:00100000:2.0:1787114998.493724:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1 00000100:00100000:2.0:1787114998.493735:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+35:10430:x1873925602580864:12345-192.168.202.10@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787114998.493812:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+35:10430:x1873925602580864:12345-192.168.202.10@tcp:900:lhsmtool_posix.0 Request processed in 79us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114998.493820:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1 00000100:00080000:2.0:1787114998.493839:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787114998.509030:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114998.509224:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602580992 00000100:00100000:3.0:1787114998.509244:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602580992 00000100:00100000:3.0:1787114998.509989:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 68 00000100:00100000:3.0:1787114998.510008:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+35:10430:x1873925602580992:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787114998.510068:0:5785:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787114998.510268:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+35:10430:x1873925602580992:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 Request processed in 266us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114998.510276:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 68 00000100:00100000:2.0:1787114998.529260:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114998.531161:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602581120 00000100:00100000:3.0:1787114998.531183:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602581120 00000100:00100000:3.0:1787114998.532024:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 69 00000100:00100000:3.0:1787114998.532038:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+35:10430:x1873925602581120:12345-192.168.202.10@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787114998.532189:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c884b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.533062:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c884b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.533081:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c884b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.533138:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8852 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.533147:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8852 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.533156:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8852 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.534385:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8859 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.534413:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.534425:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787114998.534496:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787114998.534533:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787114998.534557:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.534574:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c884b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.534581:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c884b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.534589:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c884b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.534595:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429ca600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787114998.534600:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c884b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.534608:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c884b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.534622:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8af0510d6d00) 00010000:00010000:3.0:1787114998.534626:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787114998.534632:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c884b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.534638:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c884b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.534659:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8852 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.534666:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8852 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.534684:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8852 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.534690:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429ca000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787114998.535447:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8852 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.535462:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8852 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.535475:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8af044d99500) 00010000:00010000:3.0:1787114998.535478:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787114998.535483:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8852 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.535490:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8852 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.535518:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.535525:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8859 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.535532:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8859 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.535538:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cba00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787114998.535541:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8859 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.535561:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8859 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.535570:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0514c6a00) 00010000:00010000:3.0:1787114998.535573:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787114998.535576:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8859 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.535581:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8859 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114998.537643:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+35:10430:x1873925602581120:12345-192.168.202.10@tcp:34:lhsmtool_posix.0 Request processed in 5593us (8395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114998.537661:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 69 00000100:00100000:0.0:1787114998.550467:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114998.554855:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602581376 00000100:00100000:2.0:1787114998.554882:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602581376 00000100:00100000:2.0:1787114998.554960:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 70 00000100:00100000:2.0:1787114998.554971:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+35:10430:x1873925602581376:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787114998.554993:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114998.555020:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c8860 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1512 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.555169:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c8867 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.555204:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c8867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.555217:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c8867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787114998.555229:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787114998.555334:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c8867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.555341:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c8867 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.555348:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c8867 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.555355:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787114998.555359:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c8867 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.555366:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c8867 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.555378:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0514c6a00) 00010000:00010000:2.0:1787114998.555381:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787114998.555386:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c8867 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.555392:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c8867 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.555555:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c8860 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1512 expref: 37 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.555572:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8af0510d6d00) 00010000:00010000:2.0:1787114998.555574:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787114998.555579:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c8860 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1512 expref: 37 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.555589:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3c00, rc 0) 00000100:00100000:2.0:1787114998.555654:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+36:10430:x1873925602581376:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 684us (5200us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1787114998.555660:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 70 00000100:00100000:3.0:1787114998.565301:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114998.565507:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602581504 00000100:00100000:0.0:1787114998.565521:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602581504 00000100:00100000:0.0:1787114998.565606:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 71 00000100:00100000:0.0:1787114998.565616:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+36:10430:x1873925602581504:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787114998.565657:0:5787:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787114998.565778:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+36:10430:x1873925602581504:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 Request processed in 163us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114998.565785:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 71 00000100:00100000:3.0:1787114998.574702:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114998.590496:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602581760 00000100:00100000:0.0:1787114998.590513:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602581760 00000100:00100000:1.0:1787114998.590680:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 72 00000100:00100000:1.0:1787114998.590696:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+36:10430:x1873925602581760:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787114998.590844:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787114998.590849:0:7216:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787114998.590891:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8821 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1504 expref: 36 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114998.591039:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:1.0:1787114998.591055:0:7216:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787114998.591076:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8875 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1519 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787114998.599189:0:7216:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787114998.600069:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c887c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114998.600096:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c887c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114998.600284:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c887c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114998.601248:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8875 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1519 expref: 38 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114998.601277:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c887c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1519 expref: 37 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114998.601288:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8af0510d6800) 00010000:00010000:1.0:1787114998.601291:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787114998.601653:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a1400, rc 0) 00000100:00100000:1.0:1787114998.602015:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+37:10430:x1873925602581760:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 11318us (27327us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787114998.602026:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 72 00000040:00080000:1.0:1787114998.630746:0:11831:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787114998.630762:0:11831:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787114998.630851:0:11831:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787114998.630859:0:11831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787114998.632141:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114998.632282:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602582016 00000100:00100000:3.0:1787114998.632299:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602582016 00000100:00100000:3.0:1787114998.632382:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 73 00000100:00100000:3.0:1787114998.632395:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+37:10430:x1873925602582016:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787114998.632479:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787114998.632519:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c887c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1519 expref: 37 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.633025:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8af0510d6800) 00010000:00010000:3.0:1787114998.633050:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787114998.633086:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c888a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.633164:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c888a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.633177:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c888a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.633197:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8891 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x627fde5f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.633216:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x627fde5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.633223:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x627fde5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.633964:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c888a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.633976:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c888a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.633984:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c888a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.633991:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cba00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787114998.633997:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c888a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.634007:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c888a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.634019:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:3.0:1787114998.634040:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787114998.634058:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c888a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.634065:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c888a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.634080:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x627fde5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.634087:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8891 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x627fde5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.634093:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8891 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x627fde5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.634098:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429ca000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787114998.634101:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8891 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x627fde5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.634136:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8891 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x627fde5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.634145:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x627fde5f (ffff8af044d99500) 00010000:00010000:3.0:1787114998.634148:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787114998.634151:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8891 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x627fde5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.634156:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8891 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x627fde5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114998.637829:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+36:10430:x1873925602582016:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 Request processed in 5419us (5704us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787114998.637859:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 73 00000100:00100000:3.0:1787114998.648476:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114998.648720:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602582144 00000100:00100000:2.0:1787114998.648735:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602582144 00000100:00100000:2.0:1787114998.648801:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 74 00000100:00100000:2.0:1787114998.648812:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+36:10430:x1873925602582144:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787114998.648832:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114998.648854:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c8898 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1520 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.648894:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c889f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.648909:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c889f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.648920:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c889f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.649020:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c8898 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1520 expref: 38 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.649059:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c889f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1520 expref: 37 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.649068:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8af0514c6300) 00010000:00010000:2.0:1787114998.649071:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787114998.649075:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2200, rc 0) 00000100:00100000:2.0:1787114998.649170:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+37:10430:x1873925602582144:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 359us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114998.649190:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 74 00000100:00100000:1.0:1787114998.662481:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114998.662878:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602582400 00000100:00100000:3.0:1787114998.662900:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602582400 00000100:00100000:3.0:1787114998.662977:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 75 00000100:00100000:3.0:1787114998.662994:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+37:10430:x1873925602582400:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787114998.663104:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c88a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.663170:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c88a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.663296:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c88a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787114998.664037:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1787114998.664064:0:5786:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 327649955678ns, next at 328649951908ns, rc = 0 00000004:00010000:3.0:1787114998.665022:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003caf4624 reply state 0000000004eeae08 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c88a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114998.665039:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787114998.665246:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+39:10430:x1873925602582400:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 Request processed in 2254us (2775us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1787114998.665256:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 75 00010000:00010000:2.0:1787114998.673583:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c88a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.673610:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c88a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.673618:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c88a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.673625:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429ca000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787114998.673629:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c88a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.673638:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c88a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.673654:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8af0514c6300) 00010000:00010000:2.0:1787114998.673657:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787114998.673661:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c88a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.673682:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c88a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114998.673934:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114998.674105:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602582528 00000100:00100000:2.0:1787114998.674137:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602582528 00000100:00100000:2.0:1787114998.674198:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 76 00000100:00100000:2.0:1787114998.674216:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+38:10430:x1873925602582528:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787114998.674240:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114998.674258:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c88ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1527 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.674319:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c88ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1527 expref: 39 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.674334:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c88ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1527 expref: 39 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.674354:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8af0514c6300) 00010000:00010000:2.0:1787114998.674356:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787114998.674359:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3c00, rc 0) 00000100:00100000:2.0:1787114998.674610:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+39:10430:x1873925602582528:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 395us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114998.674618:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 76 00000100:00100000:2.0:1787114998.698338:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114998.698421:0:11535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602582656 00000100:00100000:3.0:1787114998.698434:0:11535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602582656 00000100:00100000:3.0:1787114998.698490:0:11535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 25 00000100:00100000:3.0:1787114998.698518:0:11535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1873925602582656:12345-192.168.202.10@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787114998.698560:0:11535:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp t0 exp 0000000000000000 cur 327 last 0 00000020:00000080:3.0:1787114998.698609:0:11535:0:(genops.c:1406:class_connect()) connect: client 6aef9ffe-3b7b-498c-9a5a-a012c6970297, cookie 0x194cd781e88c88b4 00002000:00100000:3.0:1787114998.698623:0:11535:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6aef9ffe-3b7b-498c-9a5a-a012c6970297/ffff8af046f21000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113803 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787114998.698649:0:11535:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787114998.700707:0:11535:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787114998.700759:0:11535:0:(import.c:65:import_set_state_nolock()) ffff8af046f20800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787114998.701056:0:11535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2360:x1873925602582656:12345-192.168.202.10@tcp:8:lhsmtool_posix.0 Request processed in 2537us (2726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114998.701068:0:11535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 25 00000100:00100000:2.0:1787114998.711778:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114998.712303:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602582784 00000100:00100000:3.0:1787114998.712315:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602582784 00000100:00100000:3.0:1787114998.712492:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 26 00000100:00100000:3.0:1787114998.712506:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:0:x1873925602582784:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787114998.729453:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787114998.861971:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:0:x1873925602582784:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 Request processed in 149453us (150187us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787114998.861988:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 26 00000001:00080000:1.0:1787114998.865764:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:1.0:1787114998.865799:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6aef9ffe-3b7b-498c-9a5a-a012c6970297 00000100:00100000:3.0:1787114998.870647:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114998.877484:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602583040 00000100:00100000:0.0:1787114998.877507:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602583040 00000100:00100000:0.0:1787114998.877644:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00100000:0.0:1787114998.877657:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+39:10430:x1873925602583040:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787114998.878005:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+40:10430:x1873925602583040:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 Request processed in 350us (7372us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787114998.878014:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00100000:3.0:1787114998.889584:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114998.889670:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602583296 00000100:00100000:2.0:1787114998.889692:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602583296 00000100:00100000:2.0:1787114998.889774:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 77 00000100:00100000:2.0:1787114998.889786:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+40:10430:x1873925602583296:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787114998.889956:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+40:10430:x1873925602583296:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 Request processed in 172us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114998.889964:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 77 00000100:00100000:3.0:1787114998.899569:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114998.899649:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602583424 00000100:00100000:0.0:1787114998.899666:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602583424 00000100:00100000:0.0:1787114998.899747:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 78 00000100:00100000:0.0:1787114998.899759:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07398bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+40:10430:x1873925602583424:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787114998.899788:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114998.899815:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c88bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d152e expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114998.900435:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c88c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114998.900468:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c88c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114998.900484:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c88c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787114998.900531:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787114998.900553:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c88c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114998.900584:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c88bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d152e expref: 42 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114998.900602:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c88c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d152e expref: 41 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114998.900613:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8af0514c6300) 00010000:00010000:0.0:1787114998.900617:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787114998.900621:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030e00, rc 0) 00000100:00100000:0.0:1787114998.900718:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07398bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+41:10430:x1873925602583424:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 961us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114998.900726:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 78 00000100:00100000:0.0:1787114998.906735:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114998.906823:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602583552 00000100:00100000:2.0:1787114998.906835:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602583552 00000100:00100000:2.0:1787114998.906921:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 27 00000100:00100000:2.0:1787114998.906934:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2363:x1873925602583552:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787114998.906960:0:6577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787114998.906992:0:6577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061e725fe/0x194cd781e88c88c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1535 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787114998.907027:0:6577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8535f7, blocks: 0x1 00010000:00010000:2.0:1787114998.907061:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=327s v=(0 0) 00010000:00010000:2.0:1787114998.907067:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787114998.907080:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061e725fe/0x194cd781e88c88c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1535 expref: 6 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.907104:0:6577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061e725fe/0x194cd781e88c88c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1535 expref: 6 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114998.907149:0:6577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3a00, rc 0) 00000100:00100000:2.0:1787114998.907236:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2363:x1873925602583552:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 303us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114998.907260:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 27 00000100:00100000:3.0:1787114998.923226:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787114998.923777:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602583808 00000100:00100000:2.0:1787114998.923793:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602583808 00000100:00100000:2.0:1787114998.923877:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 79 00000100:00100000:2.0:1787114998.923890:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+41:10430:x1873925602583808:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787114998.924913:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+41:10430:x1873925602583808:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 Request processed in 1018us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114998.924927:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 79 00000100:00100000:3.0:1787114998.931450:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114998.941481:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602583936 00000100:00100000:1.0:1787114998.941504:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602583936 00000100:00100000:0.0:1787114998.942607:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 28 00000100:00100000:0.0:1787114998.942828:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:10430:x1873925602583936:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787114998.942855:0:6578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787114998.942889:0:6578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c88d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d153c expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114998.942941:0:6578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061e725fe/0x194cd781e88c88c9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1535 expref: 7 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114998.942952:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787114998.942958:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787114998.942964:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c88d0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d153c expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114998.943008:0:6578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061e725fe/0x194cd781e88c88c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1535 expref: 7 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114998.943026:0:6578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061e725fe/0x194cd781e88c88c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1535 expref: 7 pid: 6577 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114998.943056:0:6578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6578:1873925624627712:192.168.202.10@tcp:104: 00000100:00100000:0.0:1787114998.943205:0:6578:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af073aebb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787114998.952086:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114998.952158:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602584064 00000100:00100000:1.0:1787114998.952171:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602584064 00010000:00010000:1.0:1787114998.952235:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061e725fe/0x194cd781e88c88c9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1535 expref: 8 pid: 6577 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114998.952283:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 42 00000100:00100000:1.0:1787114998.952295:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2364:x1873925602584064:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787114998.952326:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787114998.952358:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061e725fe/0x194cd781e88c88c9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1535 expref: 8 pid: 6577 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114998.952373:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061e725fe/0x194cd781e88c88c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1535 expref: 8 pid: 6577 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114998.952407:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787114998.952412:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787114998.952422:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c88d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d153c expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114998.952435:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c88d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d153c expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114998.952518:0:5772:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c88d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d153c expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114998.952536:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eecdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5772:1873925624627840:192.168.202.10@tcp:105: 00000100:00100000:1.0:1787114998.952634:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af07b83fd80 going to sleep for 11 seconds 00010000:00010000:3.0:1787114998.953218:0:6578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061e725fe/0x194cd781e88c88c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1535 expref: 8 pid: 6577 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114998.953258:0:6578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6578:1873925624627712:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787114998.953289:0:6578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c88d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d153c expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114998.953544:0:6578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030c00, rc 0) 00000100:00100000:3.0:1787114998.953600:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:10430:x1873925602583936:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 10777us (22166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114998.953610:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 28 00000100:00100000:3.0:1787114998.984734:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eecdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5772:1873925624627840:192.168.202.10@tcp:105: 00010000:00010000:3.0:1787114998.984780:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787114998.984874:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602584064:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 32568us (32787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114998.984887:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 42 00000100:00100000:1.0:1787114999.006595:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114999.008530:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602584192 00000100:00100000:3.0:1787114999.008553:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602584192 00002000:00100000:3.0:1787114999.008629:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8af06eecdf80 x1873925602584192/t0(0) o4->6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp:565/0 lens 504/0 e 0 to 0 dl 1787115010 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787114999.008643:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af06eecdf80 with x1873925602584192 ext(0->8) 00002000:00010000:3.0:1787114999.008649:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af06eecdf80 00000100:00100000:3.0:1787114999.008715:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:3.0:1787114999.008726:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2363:x1873925602584192:12345-192.168.202.10@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787114999.017898:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2363:x1873925602584192:12345-192.168.202.10@tcp:4:lhsmtool_posix.0 Request processed in 9164us (11309us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787114999.017922:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 0 00002000:00100000:3.0:1787114999.017935:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8af06eecdf80 x1873925602584192/t4294967302(0) o4->6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp:565/0 lens 504/448 e 0 to 0 dl 1787115010 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787114999.017945:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af06eecdf80 with x1873925602584192 ext(0->8) 00002000:00010000:3.0:1787114999.017952:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af06eecdf80 00000100:00100000:1.0:1787114999.032938:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114999.033096:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602584320 00000100:00100000:3.0:1787114999.033134:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602584320 00000100:00100000:3.0:1787114999.034196:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 80 00000100:00100000:2.0:1787114999.034746:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+41:10430:x1873925602584320:12345-192.168.202.10@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1787114999.111328:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787114999.142248:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000100:00100000:0.0:1787114999.142534:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+40:10430:x1873925602584320:12345-192.168.202.10@tcp:44:lhsmtool_posix.0 Request processed in 107857us (109598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114999.142548:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 80 00000020:00080000:1.0:1787114999.142879:0:5807:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1787114999.142921:0:5818:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1787114999.142935:0:5818:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:1.0:1787114999.142950:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:1.0:1787114999.143206:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787114999.143267:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f8cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624627968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787114999.143335:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114999.143481:0:11535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624627968 00000100:00100000:3.0:1787114999.143491:0:11535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624627968 00000100:00100000:3.0:1787114999.143550:0:11535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787114999.143562:0:11535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624627968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787114999.143761:0:11535:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787114999.143766:0:11535:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787114999 00002000:00010000:3.0:1787114999.143768:0:11535:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787114999.143771:0:11535:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787114999 -> 1787114999 00002000:00010000:3.0:1787114999.143773:0:11535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787114999.143866:0:11535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1873925624627968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 307us (531us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787114999.143874:0:11535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1787114999.143938:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8af07f8cdf80/2, rc 0, transno 4294967303 00000100:00100000:1.0:1787114999.143945:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f8cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624627968:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1787114999.144285:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787114999.144968:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114999.145085:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602584448 00000100:00100000:0.0:1787114999.145094:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602584448 00000100:00100000:2.0:1787114999.145851:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 30 00000100:00100000:2.0:1787114999.145868:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2364:x1873925602584448:12345-192.168.202.10@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787114999.173069:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114999.173152:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114999.173185:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114999.173232:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602584576 00000100:00100000:3.0:1787114999.173245:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602584576 00000100:00100000:3.0:1787114999.173889:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 289 00000100:00100000:3.0:1787114999.173902:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602584576:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787114999.173992:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602584576:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 93us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114999.174001:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 289 00000100:00100000:3.0:1787114999.174061:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602584832 00000100:00100000:3.0:1787114999.174066:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602584832 00000100:00100000:3.0:1787114999.174138:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 147 00000100:00100000:3.0:1787114999.174147:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602584832:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787114999.174182:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602584832:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 38us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114999.174190:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 147 00000100:00080000:3.0:1787114999.178067:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787114999.180739:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602584704 00000100:00100000:2.0:1787114999.180759:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602584704 00000100:00100000:2.0:1787114999.180862:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 62 00000100:00100000:2.0:1787114999.180875:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2362:x1873925602584704:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787114999.180994:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2362:x1873925602584704:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 121us (7938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114999.181003:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 62 00000100:00080000:3.0:1787114999.181265:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787114999.199021:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1787114999.199061:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1787114999.199417:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602584448:12345-192.168.202.10@tcp:16:lhsmtool_posix.0 Request processed in 53545us (54443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114999.199432:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 30 00000100:00100000:3.0:1787114999.206510:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114999.206645:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602585088 00000100:00100000:1.0:1787114999.206663:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602585088 00000100:00100000:1.0:1787114999.206743:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 81 00000100:00100000:1.0:1787114999.206756:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+13:10430:x1873925602585088:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787114999.206848:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787114999.206906:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c88c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d152e expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.206932:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8af0514c6300) 00010000:00010000:1.0:1787114999.206939:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787114999.206982:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.206999:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.207011:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787114999.207647:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b7947d80 reply state 00000000538d51b3 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114999.207662:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787114999.207793:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+14:10430:x1873925602585088:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 Request processed in 1039us (1297us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1787114999.207802:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 81 00000100:00100000:0.0:1787114999.213204:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114999.213904:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602585216 00000100:00100000:1.0:1787114999.213921:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602585216 00000100:00100000:1.0:1787114999.213992:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 31 00000100:00100000:1.0:1787114999.214003:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602585216:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787114999.216749:0:6578:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787114999.216767:0:6578:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787114999 -> 1787114997 00002000:00010000:1.0:1787114999.216772:0:6578:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787114995 00002000:00010000:1.0:1787114999.216775:0:6578:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787114999 -> 1787114997 00002000:00010000:1.0:1787114999.216801:0:6578:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787114999.216942:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2364:x1873925602585216:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 Request processed in 2929us (3751us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787114999.216956:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 31 00010000:00010000:3.0:1787114999.217396:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114999.217412:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114999.217423:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114999.217431:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787114999.217438:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114999.217448:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114999.217648:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8af0514c6300) 00010000:00010000:3.0:1787114999.217652:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787114999.217658:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114999.217666:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114999.222162:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114999.222483:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602585472 00000100:00100000:0.0:1787114999.222519:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602585472 00000100:00100000:0.0:1787114999.222594:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 82 00000100:00100000:0.0:1787114999.222607:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+13:10430:x1873925602585472:12345-192.168.202.10@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787114999.222703:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c88de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.222724:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c889f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1520 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.222735:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c88de lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.222778:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c889f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1520 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.222793:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c889f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1520 expref: 13 pid: 5785 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114999.222936:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1873925624628096:192.168.202.10@tcp:104: 00000100:00100000:0.0:1787114999.223238:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af073aebd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787114999.231316:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1873925624628096:192.168.202.10@tcp:104: 00010000:00010000:0.0:1787114999.231359:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c88de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114999.233298:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114999.233717:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602585600 00000100:00100000:1.0:1787114999.233730:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602585600 00010000:00010000:1.0:1787114999.233786:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c889f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1520 expref: 14 pid: 5785 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114999.233851:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 43 00000100:00100000:1.0:1787114999.233862:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+14:2364:x1873925602585600:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787114999.233881:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787114999.233889:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c889f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1520 expref: 14 pid: 5785 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.233905:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c889f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1520 expref: 14 pid: 5785 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.233934:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c889f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1520 expref: 14 pid: 5785 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.233958:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8af0514c6300) 00010000:00010000:1.0:1787114999.233964:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c88de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.233976:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c88de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.234008:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c88de lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114999.234244:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c88de lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114999.234253:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c88de lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114999.234294:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c88de lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114999.234301:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c88de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114999.234307:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c88de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114999.234314:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787114999.234320:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c88de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114999.234328:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c88de lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787114999.234349:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8af0514c6300) 00010000:00010000:3.0:1787114999.234352:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787114999.234358:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c88de lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114999.234449:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+13:10430:x1873925602585472:12345-192.168.202.10@tcp:55:lhsmtool_posix.0 Request processed in 11844us (12357us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787114999.234459:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 82 00010000:00010000:1.0:1787114999.235131:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c88de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.235157:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787114999.235338:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+12:2364:x1873925602585600:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1475us (2048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114999.235347:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 43 00000100:00100000:3.0:1787114999.251265:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114999.251418:0:11535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602585728 00000100:00100000:0.0:1787114999.251432:0:11535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602585728 00000100:00100000:0.0:1787114999.251513:0:11535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 32 00000100:00100000:0.0:1787114999.251527:0:11535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2363:x1873925602585728:12345-192.168.202.10@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787114999.251618:0:11535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c88e5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.251643:0:11535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c88d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d153c expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.251653:0:11535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787114999.251659:0:11535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787114999.251679:0:11535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c88e5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.251730:0:11535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c88d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d153c expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.251747:0:11535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c88d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d153c expref: 7 pid: 6578 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114999.251769:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11535:1873925624628224:192.168.202.10@tcp:104: 00000100:00100000:0.0:1787114999.251966:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af073aebd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787114999.268590:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114999.268884:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11535:1873925624628224:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787114999.268925:0:11535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c88e5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114999.269337:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602585856 00000100:00100000:1.0:1787114999.269348:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602585856 00010000:00010000:1.0:1787114999.269402:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c88d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d153c expref: 8 pid: 6578 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114999.269495:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 44 00000100:00100000:1.0:1787114999.269506:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2363:x1873925602585856:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787114999.269526:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787114999.269554:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c88d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d153c expref: 8 pid: 6578 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.269570:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c88d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d153c expref: 8 pid: 6578 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.269598:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c88d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d153c expref: 8 pid: 6578 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.269647:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787114999.269651:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787114999.269658:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c88e5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.269668:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c88e5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.269706:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787114999.269789:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2363:x1873925602585856:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 284us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114999.269798:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 44 00010000:00010000:0.0:1787114999.275714:0:11535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c88e5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.275745:0:11535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c88e5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.275827:0:11535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c88e5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.275837:0:11535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c88e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.275846:0:11535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c88e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.275855:0:11535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030400 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787114999.275861:0:11535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c88e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.275872:0:11535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c88e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.275906:0:11535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c88e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.275915:0:11535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c88e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114999.276388:0:11535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2363:x1873925602585728:12345-192.168.202.10@tcp:1:lhsmtool_posix.0 Request processed in 24856us (25129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114999.276413:0:11535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 32 00000100:00100000:0.0:1787114999.284534:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114999.288446:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602586112 00000100:00100000:1.0:1787114999.288531:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602586112 00000100:00100000:1.0:1787114999.288680:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 83 00000100:00100000:1.0:1787114999.288692:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+12:10430:x1873925602586112:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787114999.288811:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c88ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.288833:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c88ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.288848:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c88ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.289189:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.289221:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c88ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1527 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.289231:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88f3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.289273:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c88ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1527 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.289288:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c88ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1527 expref: 13 pid: 5785 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114999.289306:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eecf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1873925624628352:192.168.202.10@tcp:104: 00000100:00100000:1.0:1787114999.289413:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af07f80e180 going to sleep for 11 seconds 00000100:00100000:2.0:1787114999.296690:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787114999.296855:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602586240 00000100:00100000:0.0:1787114999.296869:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602586240 00010000:00010000:0.0:1787114999.296929:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c88ad lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1527 expref: 14 pid: 5785 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787114999.296982:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 45 00000100:00100000:0.0:1787114999.296991:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+14:2363:x1873925602586240:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787114999.297008:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787114999.297015:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c88ad lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1527 expref: 14 pid: 5785 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.297027:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c88ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1527 expref: 14 pid: 5785 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.297064:0:6592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8af0514c6300) 00010000:00010000:0.0:1787114999.297072:0:6592:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.297084:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.297092:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88f3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.297255:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787114999.297314:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c88ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1527 expref: 14 pid: 5785 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114999.297337:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eecf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1873925624628352:192.168.202.10@tcp:104: 00010000:00010000:1.0:1787114999.297370:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.297438:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.297473:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787114999.297718:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1787114999.298048:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1787114999.298153:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1787114999.298292:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5785:1873925624628480:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787114999.298374:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114999.298415:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5f0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787114999.298426:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624628480 00000100:00100000:1.0:1787114999.298433:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624628480 00000100:00100000:1.0:1787114999.298481:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787114999.298489:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f19ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5785:x1873925624628480:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787114999.298574:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f19ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5785:x1873925624628480:12345-0@lo:1000:mdt00_000.0 Request processed in 85us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114999.298589:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787114999.299226:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+16:2363:x1873925602586240:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 2230us (2547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787114999.299247:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 45 00000100:00100000:2.0:1787114999.299736:0:5785:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1787114999.299745:0:5785:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8af07f8cdf80, transno 4294967303 00000100:00100000:2.0:1787114999.299767:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5785:1873925624628480:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787114999.300329:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1787114999.300412:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f19b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5785:1873925624628608:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787114999.300478:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114999.300507:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5f09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787114999.300523:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624628608 00000100:00100000:1.0:1787114999.300529:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624628608 00000100:00100000:1.0:1787114999.300579:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787114999.300588:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5785:x1873925624628608:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787114999.301071:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5785:x1873925624628608:12345-0@lo:1000:mdt00_000.0 Request processed in 482us (590us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787114999.301078:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787114999.301251:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f19b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5785:1873925624628608:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787114999.301298:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.301310:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88f3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.301318:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.301324:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787114999.301329:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.301350:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88f3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.301371:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8af0514c6300) 00010000:00010000:2.0:1787114999.301374:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787114999.301380:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88f3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.301386:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c88f3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.301440:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8828 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.301446:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8828 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.301453:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8828 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.301458:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2a00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787114999.301461:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8828 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.301467:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8828 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.301476:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0514c6a00) 00010000:00010000:2.0:1787114999.301478:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787114999.301482:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8828 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.301498:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8828 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.301551:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c88fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.301569:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8844 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d150b expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.301579:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c88fa lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.301616:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8844 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d150b expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.301633:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8844 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d150b expref: 16 pid: 5787 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114999.301648:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f198000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1873925624628736:192.168.202.10@tcp:104: 00000100:00100000:2.0:1787114999.304150:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5f0840 going to sleep for 11 seconds 00000100:00100000:2.0:1787114999.309755:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787114999.312895:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602586368 00000100:00100000:1.0:1787114999.312920:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602586368 00010000:00010000:1.0:1787114999.312987:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8844 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d150b expref: 17 pid: 5787 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787114999.313066:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 46 00000100:00100000:1.0:1787114999.313079:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f19b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+17:2363:x1873925602586368:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787114999.313101:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787114999.313156:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8844 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d150b expref: 17 pid: 5787 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.313174:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8844 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d150b expref: 17 pid: 5787 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.313215:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0514c6a00) 00010000:00010000:1.0:1787114999.313221:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c88fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.313234:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c88fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.313260:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c88fa lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787114999.313286:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787114999.313367:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f19b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+17:2363:x1873925602586368:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 290us (3626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114999.313375:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 46 00010000:00010000:3.0:1787114999.316958:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8844 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d150b expref: 16 pid: 5787 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787114999.316986:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f198000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1873925624628736:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787114999.317014:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c88fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.317101:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c88fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.317127:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c88fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.317144:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c88fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.317179:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c88fa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.317187:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c88fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.317194:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787114999.317420:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c88fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.317431:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c88fa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.317452:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0514c6a00) 00010000:00010000:2.0:1787114999.317455:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787114999.317462:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c88fa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.317480:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c88fa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.319409:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c88ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.319420:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c88ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.319428:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c88ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.319436:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787114999.319461:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c88ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.319470:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c88ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.319489:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0514c6a00) 00010000:00010000:2.0:1787114999.319492:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787114999.319496:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c88ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.319504:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c88ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787114999.319882:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+15:10430:x1873925602586112:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 Request processed in 31185us (35354us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1787114999.319896:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 83 00000020:00080000:2.0:1787114999.319904:0:5785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787114999.320978:0:11519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787114999.320986:0:11519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787114999.321021:0:11519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787114999.321030:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787114999.326650:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787114999.326740:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602586624 00000100:00100000:3.0:1787114999.326749:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602586624 00000100:00100000:3.0:1787114999.326828:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 20 00000100:00100000:3.0:1787114999.326838:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+15:10430:x1873925602586624:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787114999.327942:0:5788:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787114999.328089:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1787114999.328432:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8901 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.328457:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.328485:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.328497:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8901 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.328504:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8901 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.328511:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8901 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787114999.328601:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787114999.328754:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+17:10430:x1873925602586624:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 Request processed in 1911us (2107us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1787114999.328766:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 20 00000020:00080000:0.0:1787114999.328773:0:5788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787114999.333423:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787114999.333446:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8901 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.333461:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030a00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787114999.333479:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8901 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.333491:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8901 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.333518:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8af051ecba00) 00010000:00010000:2.0:1787114999.333547:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787114999.333554:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8901 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.333562:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8901 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787114999.333593:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114999.333595:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787114999.333597:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787114999.686089:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624628864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787114999.686246:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787114999.686704:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624628864 00000100:00100000:1.0:1787114999.686717:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624628864 00000100:00100000:1.0:1787114999.686817:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787114999.686829:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1873925624628864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787114999.686893:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787114999.686969:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1873925624628864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787114999.686978:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1787114999.687239:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787114999.687503:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624629248:0@lo:400:kworker.0 00000100:00100000:2.0:1787114999.687558:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787114999.687603:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787114999.687611:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f19a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624629120:0@lo:400:kworker.0 00000100:00100000:2.0:1787114999.687638:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114999.688255:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f19aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624628992:0@lo:400:kworker.0 00000100:00100000:3.0:1787114999.688307:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114999.688356:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787114999.688363:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624629376:0@lo:400:kworker.0 00000100:00100000:3.0:1787114999.688389:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787114999.688427:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624629248 00000100:00100000:3.0:1787114999.688435:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624629248 00000100:00100000:3.0:1787114999.688506:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624629120 00000100:00100000:3.0:1787114999.688510:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624629120 00000100:00100000:3.0:1787114999.688523:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624629376 00000100:00100000:3.0:1787114999.688526:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624629376 00000100:00100000:3.0:1787114999.688542:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787114999.688550:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624629248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114999.688786:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624629248:12345-0@lo:400:kworker.0 Request processed in 235us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114999.688795:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787114999.688819:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787114999.688826:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624629120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114999.688873:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624629120:12345-0@lo:400:kworker.0 Request processed in 48us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114999.688880:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787114999.688893:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787114999.688900:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624629376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787114999.688934:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624629376:12345-0@lo:400:kworker.0 Request processed in 34us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787114999.688970:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:3.0:1787114999.688991:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787114999.689047:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f19a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624629120:0@lo:400:kworker.0 00000100:00100000:3.0:1787114999.689065:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624629248:0@lo:400:kworker.0 00000100:00100000:3.0:1787114999.689103:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624629376:0@lo:400:kworker.0 00000100:00100000:0.0:1787114999.689356:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624628864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787114999.690246:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624628992 00000100:00100000:2.0:1787114999.690258:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624628992 00000100:00100000:2.0:1787114999.690319:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787114999.690329:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624628992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787114999.690423:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624628992:12345-0@lo:400:kworker.0 Request processed in 95us (2115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787114999.690431:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787114999.690762:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f19aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624628992:0@lo:400:kworker.0 00010000:00010000:3.0:1787115000.134264:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787115000.198473:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624629504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787115000.198577:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115000.198689:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624629504 00000100:00100000:0.0:1787115000.198700:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624629504 00000100:00100000:0.0:1787115000.198760:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787115000.198771:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1873925624629504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787115000.198831:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787115000.198900:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1873925624629504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115000.198909:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787115000.198984:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624629504:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787115000.283560:0:6604:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:3.0:1787115000.283659:0:6604:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000040:00080000:0.0:1787115000.897864:0:11886:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787115000.897876:0:11886:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787115000.897929:0:11886:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787115000.897935:0:11886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787115001.134071:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115001.134608:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602586880 00000100:00100000:3.0:1787115001.134624:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602586880 00000100:00080000:2.0:1787115001.135175:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787115001.135576:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 84 00000100:00100000:0.0:1787115001.135591:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+17:10448:x1873925602586880:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1787115001.135637:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115001.135671:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8908 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1543 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.136065:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c890f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.136140:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c890f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.136168:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c890f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115001.136559:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787115001.136782:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8908 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1543 expref: 20 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.136855:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c890f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1543 expref: 19 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.136863:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:0.0:1787115001.136865:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787115001.136869:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030400, rc 0) 00000100:00100000:0.0:1787115001.136984:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+19:10448:x1873925602586880:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1398us (2934us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1787115001.136992:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 84 00000100:00100000:3.0:1787115001.140391:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115001.140484:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602587008 00000100:00100000:0.0:1787115001.140497:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602587008 00000100:00100000:0.0:1787115001.140569:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 85 00000100:00100000:0.0:1787115001.140581:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+19:10448:x1873925602587008:12345-192.168.202.10@tcp:34:lfs.0 00010000:00010000:0.0:1787115001.140701:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c891d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.140726:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c891d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.140768:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c891d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.140787:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8924 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.140802:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.140809:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141202:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c892b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141212:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c892b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141221:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c892b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787115001.141275:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c892b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141290:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c891d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141297:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c891d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141305:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c891d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141321:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115001.141327:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c891d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141336:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c891d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141351:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:0.0:1787115001.141354:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115001.141360:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c891d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141366:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c891d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141381:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141387:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8924 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141393:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8924 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141407:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115001.141410:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8924 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141416:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8924 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141434:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8af051ecbd00) 00010000:00010000:0.0:1787115001.141437:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115001.141440:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8924 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141446:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8924 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141462:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c892b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141468:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c892b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141475:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c892b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141480:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040031000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115001.141483:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c892b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141490:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c892b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141503:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:0.0:1787115001.141505:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115001.141508:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c892b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.141513:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c892b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115001.141628:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+19:10448:x1873925602587008:12345-192.168.202.10@tcp:34:lfs.0 Request processed in 1046us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115001.141637:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 85 00010000:00010000:0.0:1787115001.159501:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787115001.178968:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115001.179095:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602587264 00000100:00100000:3.0:1787115001.179564:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602587264 00000100:00100000:2.0:1787115001.179995:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 86 00000100:00100000:2.0:1787115001.180009:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f19a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+19:10451:x1873925602587264:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1787115001.180051:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115001.180099:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c8932 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d154a expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.180258:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c8939 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.180276:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c8939 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.180301:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c8939 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.180319:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8940 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.180327:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.180333:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.180726:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8947 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.180736:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.180743:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115001.180755:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787115001.180888:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c8939 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.180905:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c8939 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.180912:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c8939 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.180919:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3a00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115001.180924:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c8939 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.180934:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c8939 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.180949:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:2.0:1787115001.180952:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115001.180958:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c8939 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.180964:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c8939 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.180978:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.180985:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8940 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.180992:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8940 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.180998:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115001.181007:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8940 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.181015:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8940 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.181034:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8af0514c6300) 00010000:00010000:2.0:1787115001.181036:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115001.181039:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8940 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.181045:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8940 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.181100:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c8932 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d154a expref: 22 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.181183:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8947 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d154a expref: 21 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.181193:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0514c6a00) 00010000:00010000:2.0:1787115001.181196:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787115001.181199:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2a00, rc 0) 00000100:00100000:2.0:1787115001.181279:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f19a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+21:10451:x1873925602587264:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1274us (2327us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1787115001.181288:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 86 00000100:00100000:3.0:1787115001.208610:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115001.208713:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602587392 00000100:00100000:0.0:1787115001.208729:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602587392 00000100:00100000:0.0:1787115001.208908:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 87 00000100:00100000:0.0:1787115001.208922:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+21:10451:x1873925602587392:12345-192.168.202.10@tcp:54:lfs.0 00010000:00010000:0.0:1787115001.209029:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8955 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.209050:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8955 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.209066:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8955 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.209162:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8955 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.209170:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8955 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.209178:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8955 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.209185:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040031000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115001.209190:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8955 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.209218:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8955 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.209234:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0514c6a00) 00010000:00010000:0.0:1787115001.209237:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787115001.209243:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8955 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.209249:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8955 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115001.209515:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+21:10451:x1873925602587392:12345-192.168.202.10@tcp:54:lfs.0 Request processed in 595us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115001.209525:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 87 00000100:00100000:1.0:1787115001.225556:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115001.225630:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602587648 00000100:00100000:0.0:1787115001.225645:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602587648 00000100:00100000:0.0:1787115001.225829:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 21 00000100:00100000:0.0:1787115001.225841:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af066348850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+21:10451:x1873925602587648:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:0.0:1787115001.226188:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af066348850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+22:10451:x1873925602587648:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 347us (642us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1787115001.226197:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 21 00000100:00100000:1.0:1787115001.284452:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115001.284654:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602587904 00000100:00100000:0.0:1787115001.284664:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602587904 00000100:00100000:0.0:1787115001.285397:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 88 00000100:00100000:0.0:1787115001.285409:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+22:9972:x1873925602587904:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:0.0:1787115001.285432:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115001.285452:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c895c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1551 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.285578:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8963 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.285592:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8947 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d154a expref: 23 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.285601:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8963 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.285633:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8947 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d154a expref: 23 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.285647:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8947 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d154a expref: 23 pid: 7216 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115001.285661:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624629632:192.168.202.10@tcp:104: 00000100:00100000:0.0:1787115001.285761:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af073aeb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787115001.291635:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624629632:192.168.202.10@tcp:104: 00010000:00010000:0.0:1787115001.291662:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8963 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115001.297294:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115001.297543:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602588032 00000100:00100000:3.0:1787115001.297554:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602588032 00010000:00010000:3.0:1787115001.297598:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8947 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d154a expref: 24 pid: 7216 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115001.297643:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 47 00000100:00100000:3.0:1787115001.297653:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+24:2363:x1873925602588032:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787115001.297669:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787115001.297676:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8947 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d154a expref: 24 pid: 7216 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115001.297689:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8947 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d154a expref: 24 pid: 7216 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115001.297725:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c8947 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d154a expref: 24 pid: 7216 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115001.297742:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0514c6a00) 00010000:00010000:3.0:1787115001.297747:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8963 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115001.297757:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8963 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115001.297764:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8963 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115001.297800:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787115001.297862:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+23:2363:x1873925602588032:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 210us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115001.297870:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 47 00010000:00010000:1.0:1787115001.298266:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8963 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115001.298275:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8963 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787115001.298297:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787115001.298577:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c895c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1551 expref: 24 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115001.298592:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8963 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1551 expref: 23 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115001.298606:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0514c6a00) 00010000:00010000:1.0:1787115001.298609:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787115001.298612:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030200, rc 0) 00000100:00100000:1.0:1787115001.298647:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+23:9972:x1873925602587904:12345-192.168.202.10@tcp:101:bash.0 Request processed in 13242us (14544us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787115001.298654:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 88 00000100:00100000:0.0:1787115001.318719:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115001.318811:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602588288 00000100:00100000:2.0:1787115001.318821:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602588288 00000100:00100000:2.0:1787115001.318884:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 89 00000100:00100000:2.0:1787115001.318895:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+23:9972:x1873925602588288:12345-192.168.202.10@tcp:36:bash.0 00010000:00010000:2.0:1787115001.319379:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8971 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.319396:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8971 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.319461:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8971 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787115001.319514:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1787115001.319604:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000057640999 reply state 00000000606ff0c4 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8971 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115001.319614:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787115001.319660:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1787115001.319812:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+27:9972:x1873925602588288:12345-192.168.202.10@tcp:36:bash.0 Request processed in 918us (1100us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1787115001.319820:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 89 00000020:00080000:2.0:1787115001.319825:0:5785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1787115001.335580:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8971 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.335600:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8971 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.335608:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8971 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.335615:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115001.335620:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8971 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.335645:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8971 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.335662:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0514c6a00) 00010000:00010000:2.0:1787115001.335665:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115001.335669:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8971 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.335675:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c8971 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115001.335726:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115001.335984:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602588416 00000100:00100000:2.0:1787115001.335993:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602588416 00000100:00100000:2.0:1787115001.336068:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 90 00000100:00100000:2.0:1787115001.336079:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+26:9972:x1873925602588416:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:2.0:1787115001.336104:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115001.336188:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c8978 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1558 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.336259:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c8978 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1558 expref: 27 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.336273:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c8978 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1558 expref: 27 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.336303:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0514c6a00) 00010000:00010000:2.0:1787115001.336306:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787115001.336309:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3a00, rc 0) 00000100:00100000:2.0:1787115001.336577:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+27:9972:x1873925602588416:12345-192.168.202.10@tcp:101:bash.0 Request processed in 500us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115001.336583:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 90 00000100:00100000:3.0:1787115001.343276:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115001.343428:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602588544 00000100:00100000:1.0:1787115001.343438:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602588544 00000100:00100000:1.0:1787115001.343518:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 33 00000100:00100000:1.0:1787115001.343528:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:9972:x1873925602588544:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:1.0:1787115001.343546:0:6578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115001.343567:0:6578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d482cf92/0x194cd781e88c897f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d155f expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787115001.343595:0:6578:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8535f5, atime: 0x6a8535f3, ctime: 0x6a8535f5, blocks: 0xb 00010000:00010000:1.0:1787115001.343620:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=330s v=(0 0) 00010000:00010000:1.0:1787115001.343625:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787115001.343634:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d482cf92/0x194cd781e88c897f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d155f expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115001.343653:0:6578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d482cf92/0x194cd781e88c897f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d155f expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115001.343668:0:6578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a1400, rc 0) 00000100:00100000:1.0:1787115001.343756:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:9972:x1873925602588544:12345-192.168.202.10@tcp:101:bash.0 Request processed in 230us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115001.343763:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 33 00000100:00080000:2.0:1787115001.343943:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787115001.353666:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115001.353779:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602588672 00000100:00100000:1.0:1787115001.353789:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602588672 00002000:00010000:1.0:1787115001.353841:0:6582:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1787115001.353845:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af07f8cc700 with x1873925602588672 ext(0->18446744073709551615) 00002000:00010000:1.0:1787115001.353857:0:6582:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af07f8cc700. 00000100:00100000:1.0:1787115001.353890:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1 00000100:00100000:1.0:1787115001.353899:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2364:x1873925602588672:12345-192.168.202.10@tcp:10:bash.0 00002000:00010000:0.0:1787115001.354603:0:6582:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787115001.354608:0:6582:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787114997 -> 1787115002 00002000:00010000:0.0:1787115001.354610:0:6582:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787114995 -> 1787114995 00002000:00010000:0.0:1787115001.354625:0:6582:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787114997 -> 1787115002 00002000:00010000:0.0:1787115001.354627:0:6582:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787115001.354689:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2364:x1873925602588672:12345-192.168.202.10@tcp:10:bash.0 Request processed in 789us (1031us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787115001.354700:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1 00002000:00010000:0.0:1787115001.354704:0:6582:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1787115001.354706:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af07f8cc700 with x1873925602588672 ext(0->18446744073709551615) 00002000:00010000:0.0:1787115001.354712:0:6582:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af07f8cc700. 00000100:00100000:3.0:1787115001.468915:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115001.472753:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602588800 00000100:00100000:0.0:1787115001.472769:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602588800 00000100:00100000:0.0:1787115001.472862:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 91 00000100:00100000:0.0:1787115001.472873:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+27:10465:x1873925602588800:12345-192.168.202.10@tcp:34:lfs.0 00010000:00010000:0.0:1787115001.472960:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8986 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.472978:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8986 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.472991:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8986 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473007:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c898d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473030:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c898d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473039:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c898d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473413:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8994 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473422:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473430:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787115001.473470:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473481:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8986 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473488:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8986 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473495:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8986 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473502:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115001.473506:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8986 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473515:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8986 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473526:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:0.0:1787115001.473529:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115001.473533:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8986 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473546:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8986 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473570:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c898d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473577:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c898d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473802:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c898d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473808:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040031600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115001.473811:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c898d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473869:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c898d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473879:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8af051ecb300) 00010000:00010000:0.0:1787115001.473882:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115001.473886:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c898d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473892:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c898d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473908:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473913:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8994 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473926:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473936:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115001.473940:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473945:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8994 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473953:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0514c6a00) 00010000:00010000:0.0:1787115001.473955:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115001.473958:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8994 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.473964:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8994 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115001.474062:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+27:10465:x1873925602588800:12345-192.168.202.10@tcp:34:lfs.0 Request processed in 1189us (5157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115001.474070:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 91 00000100:00100000:3.0:1787115001.577450:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115001.577561:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602589056 00000100:00100000:2.0:1787115001.577572:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602589056 00000100:00100000:2.0:1787115001.577636:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 92 00000100:00100000:2.0:1787115001.577647:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+27:10468:x1873925602589056:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1787115001.577668:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115001.577692:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c899b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1566 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.577768:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.577783:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.577809:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.577825:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.577842:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.577851:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.578250:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c89b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.578266:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c89b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.578275:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c89b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115001.578285:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787115001.578376:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.578384:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.578391:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.578396:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115001.578400:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.578407:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.578418:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:2.0:1787115001.578421:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115001.578425:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.578431:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.578442:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.578454:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.578460:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.578465:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115001.578469:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.578475:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.578484:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8af0514c6300) 00010000:00010000:2.0:1787115001.578487:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115001.578490:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.578497:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.578535:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c899b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1566 expref: 30 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.578548:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c89b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1566 expref: 29 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.578556:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0514c6a00) 00010000:00010000:2.0:1787115001.578558:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787115001.578566:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2a00, rc 0) 00000100:00100000:2.0:1787115001.578630:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+29:10468:x1873925602589056:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 984us (1189us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787115001.578638:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 92 00000100:00100000:3.0:1787115001.583951:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115001.584207:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602589184 00000100:00100000:0.0:1787115001.584217:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602589184 00000100:00100000:0.0:1787115001.584275:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 93 00000100:00100000:0.0:1787115001.584284:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+29:10468:x1873925602589184:12345-192.168.202.10@tcp:54:lfs.0 00010000:00010000:0.0:1787115001.584361:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c89be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.584379:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8963 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1551 expref: 29 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.584404:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c89be lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.584439:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8963 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1551 expref: 29 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.584453:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8963 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1551 expref: 29 pid: 5787 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115001.584467:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1873925624629760:192.168.202.10@tcp:104: 00000100:00100000:0.0:1787115001.584563:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af073aeb300 going to sleep for 11 seconds 00000100:00100000:3.0:1787115001.589146:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115001.589227:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602589440 00000100:00100000:2.0:1787115001.589236:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602589440 00000100:00100000:2.0:1787115001.589296:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 22 00000100:00100000:2.0:1787115001.589306:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+30:5576:x1873925602589440:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787115001.589601:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+31:5576:x1873925602589440:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 297us (499us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787115001.589607:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 22 00000100:00100000:0.0:1787115001.591177:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1873925624629760:192.168.202.10@tcp:104: 00010000:00010000:0.0:1787115001.591206:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c89be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115001.592461:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115001.592520:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602589568 00000100:00100000:1.0:1787115001.592526:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602589568 00010000:00010000:1.0:1787115001.592552:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8963 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1551 expref: 31 pid: 5787 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115001.592580:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 48 00000100:00100000:1.0:1787115001.592586:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+31:2363:x1873925602589568:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787115001.592598:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787115001.592603:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8963 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1551 expref: 31 pid: 5787 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115001.592611:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8963 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1551 expref: 31 pid: 5787 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115001.592627:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8963 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1551 expref: 31 pid: 5787 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115001.592653:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0514c6a00) 00010000:00010000:1.0:1787115001.592657:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c89be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115001.592663:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c89be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115001.592669:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c89be lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115001.592689:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787115001.592724:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+30:2363:x1873925602589568:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 138us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115001.592729:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 48 00010000:00010000:0.0:1787115001.593042:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c89be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.593050:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c89be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.593080:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c89be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.593087:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c89be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.593094:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c89be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.593138:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115001.593143:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c89be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.593152:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c89be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.593162:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0514c6a00) 00010000:00010000:0.0:1787115001.593166:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787115001.593169:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c89be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115001.593186:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c89be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115001.593232:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+29:10468:x1873925602589184:12345-192.168.202.10@tcp:54:lfs.0 Request processed in 8950us (9290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115001.593240:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 93 00000100:00100000:3.0:1787115001.599713:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115001.599829:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602589824 00000100:00100000:2.0:1787115001.599839:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602589824 00000100:00100000:2.0:1787115001.599928:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 23 00000100:00100000:2.0:1787115001.599939:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+29:10468:x1873925602589824:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:2.0:1787115001.600892:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+30:10468:x1873925602589824:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 953us (1190us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787115001.600901:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 23 00000100:00100000:1.0:1787115001.715250:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115001.715589:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602590080 00000100:00100000:2.0:1787115001.715601:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602590080 00000100:00100000:2.0:1787115001.715664:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 94 00000100:00100000:2.0:1787115001.715676:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+30:10479:x1873925602590080:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1787115001.715704:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115001.715728:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c89c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d156d expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.715818:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.715843:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.715857:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.715874:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.715882:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.715889:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.716297:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c89da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.716307:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c89da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.716315:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c89da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115001.716325:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787115001.716425:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.716432:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.716444:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.716450:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115001.716454:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.716461:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.716474:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:2.0:1787115001.716477:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115001.716482:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.716488:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.716501:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.716506:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.716512:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.716516:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115001.716519:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.716535:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.716544:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8af0514c6300) 00010000:00010000:2.0:1787115001.716546:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115001.716549:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.716555:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.716598:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c89c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d156d expref: 33 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.716610:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c89da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d156d expref: 32 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.716617:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0514c6a00) 00010000:00010000:2.0:1787115001.716619:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787115001.716622:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2200, rc 0) 00000100:00100000:2.0:1787115001.716684:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+32:10479:x1873925602590080:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1009us (1445us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787115001.716692:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 94 00000100:00100000:1.0:1787115001.744142:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115001.744333:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602590336 00000100:00100000:3.0:1787115001.744343:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602590336 00000100:00100000:3.0:1787115001.744405:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 24 00000100:00100000:3.0:1787115001.744427:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eeced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+32:10479:x1873925602590336:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:3.0:1787115001.746041:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eeced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+33:10479:x1873925602590336:12345-192.168.202.10@tcp:35:cat.0 Request processed in 1610us (1940us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787115001.746052:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 24 00000100:00100000:3.0:1787115001.911756:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115001.912001:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602590592 00000100:00100000:2.0:1787115001.912021:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602590592 00000100:00100000:2.0:1787115001.912082:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 95 00000100:00100000:2.0:1787115001.912092:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+33:10481:x1873925602590592:12345-192.168.202.10@tcp:36:rm.0 00010000:00010000:2.0:1787115001.912227:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787115001.912255:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c89da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d156d expref: 33 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.912279:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2a00/0x194cd781e88c89b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1566 expref: 32 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.912292:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c8978 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1558 expref: 31 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.912303:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0514c6a00) 00010000:00010000:2.0:1787115001.912314:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787115001.912335:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c89e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.912348:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c89e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.912358:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c89e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.912373:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.912380:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.912387:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.912674:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.912684:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.912691:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787115001.915160:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1787115001.915578:0:5785:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 330901469350ns, next at 331901465419ns, rc = 0 00010000:00010000:2.0:1787115001.915647:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c89fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.915661:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c89fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.915672:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c89fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.915680:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c89fd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.915687:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c89fd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.915693:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c89fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.915719:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787115001.915740:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.915753:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89f6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.915759:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.915766:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115001.915770:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.915778:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89f6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.915790:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:2.0:1787115001.915793:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787115001.915798:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89f6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.915803:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c89f6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.915820:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c89e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.915826:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c89e8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.915978:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c89e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.915984:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115001.915993:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c89e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.915999:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c89e8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.916007:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:2.0:1787115001.916009:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115001.916023:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c89e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.916029:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c89e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787115001.916041:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000046964dc3 reply state 00000000403b813b transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115001.916049:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787115001.916242:0:8291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787115001.916248:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c89fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115001.916255:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e800 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:1.0:1787115001.916259:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c89fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115001.916265:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c89fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115001.916274:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:1.0:1787115001.916276:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787115001.916288:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c89fd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115001.916294:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c89fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115001.916313:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115001.916316:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115001.916318:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787115001.916360:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+32:10481:x1873925602590592:12345-192.168.202.10@tcp:36:rm.0 Request processed in 4264us (4608us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787115001.916369:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 95 00010000:00010000:3.0:1787115001.930821:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115001.930848:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115001.930856:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115001.930863:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115001.930868:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115001.930875:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115001.930893:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8af0514c6300) 00010000:00010000:3.0:1787115001.930896:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115001.930901:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115001.930907:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c89ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115001.995398:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115001.995660:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602590848 00000100:00100000:2.0:1787115001.995671:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602590848 00000100:00100000:2.0:1787115001.995735:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 96 00000100:00100000:2.0:1787115001.995746:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+31:10487:x1873925602590848:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:2.0:1787115001.995770:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115001.995790:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a04 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1574 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.995926:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8a0b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.995947:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8a0b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.995959:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8a0b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.995975:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8a12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.995983:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8a12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115001.995990:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8a12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787115001.997784:0:7216:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787115001.998097:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8a19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.000068:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8a19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.000086:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8a19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.000422:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8a0b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.000431:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8a0b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.000437:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8a0b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.000456:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216f800 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115002.000461:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8a0b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.000469:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8a0b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.000481:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:2.0:1787115002.000484:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115002.000488:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8a0b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.000495:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8a0b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787115002.000511:0:7216:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a5b72de5 reply state 00000000b8dfc1d7 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8a12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115002.000519:0:7216:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787115002.000555:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1574 expref: 34 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.000571:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8a19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1574 expref: 33 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.004648:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af0514c6800) 00010000:00010000:2.0:1787115002.004653:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787115002.004657:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216e600, rc 0) 00000100:00100000:2.0:1787115002.004743:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+34:10487:x1873925602590848:12345-192.168.202.10@tcp:101:bash.0 Request processed in 8994us (9349us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787115002.004766:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 96 00010000:00010000:2.0:1787115002.009965:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8a12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.009979:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8a12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.009984:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8a12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.009989:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216fa00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115002.009992:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8a12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.009997:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8a12 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.010019:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8af0514c6a00) 00010000:00010000:2.0:1787115002.010022:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115002.010027:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8a12 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.010033:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8a12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115002.011060:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115002.011180:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602590976 00000100:00100000:1.0:1787115002.011189:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602590976 00000100:00100000:1.0:1787115002.011254:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 34 00000100:00100000:1.0:1787115002.011266:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2362:x1873925602590976:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:1.0:1787115002.011284:0:6576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115002.011303:0:6576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416be2a1/0x194cd781e88c8a27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d157b expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787115002.011329:0:6576:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787115002.011349:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=330s v=(0 0) 00010000:00010000:1.0:1787115002.011353:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787115002.011363:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416be2a1/0x194cd781e88c8a27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d157b expref: 6 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.011380:0:6576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416be2a1/0x194cd781e88c8a27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d157b expref: 6 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.011394:0:6576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0e00, rc 0) 00000100:00100000:1.0:1787115002.011462:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2362:x1873925602590976:12345-192.168.202.10@tcp:101:bash.0 Request processed in 199us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115002.011486:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 34 00000100:00080000:2.0:1787115002.012385:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787115002.015618:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115002.015707:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602591104 00000100:00100000:3.0:1787115002.015717:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602591104 00000100:00100000:3.0:1787115002.015767:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 35 00000100:00100000:3.0:1787115002.015775:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:10487:x1873925602591104:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:3.0:1787115002.015801:0:6578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115002.015820:0:6578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052fff536/0x194cd781e88c8a2e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1582 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.015957:0:6578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416be2a1/0x194cd781e88c8a27 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d157b expref: 7 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.015967:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787115002.015971:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115002.015975:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052fff536/0x194cd781e88c8a2e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1582 expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.016003:0:6578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000416be2a1/0x194cd781e88c8a27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d157b expref: 7 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.016027:0:6578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000416be2a1/0x194cd781e88c8a27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d157b expref: 7 pid: 6576 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115002.016041:0:6578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06ef79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6578:1873925624629888:192.168.202.10@tcp:104: 00000100:00100000:3.0:1787115002.016616:0:6578:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045be1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787115002.021253:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115002.021811:0:6578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06ef79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6578:1873925624629888:192.168.202.10@tcp:104: 00010000:00010000:1.0:1787115002.021853:0:6578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000052fff536/0x194cd781e88c8a2e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1582 expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.021876:0:6578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429ca600, rc 0) 00000100:00100000:1.0:1787115002.021945:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:10487:x1873925602591104:12345-192.168.202.10@tcp:101:bash.0 Request processed in 6170us (6335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115002.021953:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 35 00000100:00100000:0.0:1787115002.022103:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602591232 00000100:00100000:0.0:1787115002.022148:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602591232 00010000:00010000:0.0:1787115002.022197:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000416be2a1/0x194cd781e88c8a27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d157b expref: 7 pid: 6576 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115002.022227:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 49 00000100:00100000:0.0:1787115002.022236:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2364:x1873925602591232:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787115002.022251:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787115002.022274:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000416be2a1/0x194cd781e88c8a27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d157b expref: 7 pid: 6576 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.022301:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000416be2a1/0x194cd781e88c8a27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d157b expref: 7 pid: 6576 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.022326:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416be2a1/0x194cd781e88c8a27 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d157b expref: 7 pid: 6576 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.022342:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787115002.022346:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787115002.022354:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000052fff536/0x194cd781e88c8a2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1582 expref: 6 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.022362:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052fff536/0x194cd781e88c8a2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1582 expref: 6 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.022395:0:5771:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000052fff536/0x194cd781e88c8a2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1582 expref: 6 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115002.022408:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7f6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5771:1873925624630016:192.168.202.10@tcp:105: 00000100:00100000:0.0:1787115002.022469:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af073aeb300 going to sleep for 11 seconds 00000100:00100000:0.0:1787115002.036989:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115002.037083:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602591488 00000100:00100000:2.0:1787115002.037094:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602591488 00000100:00100000:3.0:1787115002.037457:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7f6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5771:1873925624630016:192.168.202.10@tcp:105: 00010000:00010000:3.0:1787115002.037482:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787115002.037544:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602591232:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 15308us (16300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115002.037555:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 49 00000100:00100000:2.0:1787115002.038974:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 25 00000100:00100000:2.0:1787115002.038986:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+33:10487:x1873925602591488:12345-192.168.202.10@tcp:35:bash.0 00000100:00100000:2.0:1787115002.039397:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+34:10487:x1873925602591488:12345-192.168.202.10@tcp:35:bash.0 Request processed in 412us (2418us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787115002.039405:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 25 00010000:00010000:2.0:1787115002.181392:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787115002.294188:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115002.294531:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602591616 00000100:00100000:1.0:1787115002.294543:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602591616 00000100:00100000:1.0:1787115002.294596:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 97 00000100:00100000:1.0:1787115002.294605:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+34:10503:x1873925602591616:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1787115002.294629:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115002.294648:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c8a35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1589 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.294705:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8a3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.294717:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.294728:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787115002.294798:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787115002.294802:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787115002.294822:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.294906:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c8a35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1589 expref: 36 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.294924:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8a3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1589 expref: 35 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.294933:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:1.0:1787115002.294936:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787115002.294939:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0800, rc 0) 00000100:00100000:1.0:1787115002.294997:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+35:10503:x1873925602591616:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 393us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115002.295004:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 97 00000100:00100000:1.0:1787115002.300924:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115002.301076:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602591872 00000100:00100000:0.0:1787115002.301085:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602591872 00000100:00100000:0.0:1787115002.301184:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 98 00000100:00100000:0.0:1787115002.301194:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+35:10503:x1873925602591872:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1787115002.301225:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115002.301245:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8a43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1590 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.301337:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8a4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.301349:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8a4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.301361:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8a4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115002.301371:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787115002.301479:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8a43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1590 expref: 38 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.301496:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8a4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1590 expref: 37 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.301504:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af0514c6800) 00010000:00010000:0.0:1787115002.301506:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787115002.301509:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040031600, rc 0) 00000100:00100000:0.0:1787115002.301564:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+37:10503:x1873925602591872:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 371us (648us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1787115002.301571:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 98 00000100:00100000:3.0:1787115002.305167:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115002.305303:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602592128 00000100:00100000:1.0:1787115002.305312:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602592128 00000100:00100000:1.0:1787115002.305363:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 99 00000100:00100000:1.0:1787115002.305372:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+37:10503:x1873925602592128:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1787115002.305395:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115002.305415:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c8a58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1597 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.305516:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8a5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.305540:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8a5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.305552:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8a5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787115002.305564:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787115002.305674:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c8a58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1597 expref: 40 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.305690:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8a5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1597 expref: 39 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.305700:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af0514c6800) 00010000:00010000:1.0:1787115002.305703:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787115002.305706:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0e00, rc 0) 00000100:00100000:1.0:1787115002.305764:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+39:10503:x1873925602592128:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 392us (610us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1787115002.305770:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 99 00000100:00100000:3.0:1787115002.308644:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115002.308810:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602592256 00000100:00100000:1.0:1787115002.308819:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602592256 00000100:00100000:1.0:1787115002.308880:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00100000:1.0:1787115002.308888:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+39:2364:x1873925602592256:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787115002.308901:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787115002.308923:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8a4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1590 expref: 39 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.308957:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af0514c6800) 00010000:00010000:1.0:1787115002.308962:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787115002.309017:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+38:2364:x1873925602592256:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 119us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115002.309025:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00100000:3.0:1787115002.324642:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115002.324740:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602592384 00000100:00100000:1.0:1787115002.324749:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602592384 00000100:00100000:1.0:1787115002.324807:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 36 00000100:00100000:1.0:1787115002.324816:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2362:x1873925602592384:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:1.0:1787115002.324865:0:6576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c8a6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.324885:0:6576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000052fff536/0x194cd781e88c8a2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1582 expref: 6 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.324893:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787115002.324898:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787115002.324903:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c8a6d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.324935:0:6576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000052fff536/0x194cd781e88c8a2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1582 expref: 6 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.324949:0:6576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000052fff536/0x194cd781e88c8a2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1582 expref: 6 pid: 6578 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115002.324980:0:6576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eecc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6576:1873925624630144:192.168.202.10@tcp:104: 00000100:00100000:1.0:1787115002.325083:0:6576:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050747d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787115002.328167:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115002.328329:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602592512 00000100:00100000:0.0:1787115002.328338:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602592512 00002000:00100000:0.0:1787115002.328383:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8af07f8cc380 x1873925602592512/t0(0) o4->6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp:568/0 lens 504/0 e 0 to 0 dl 1787115013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787115002.328406:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af07f8cc380 with x1873925602592512 ext(0->8) 00010000:00010000:0.0:1787115002.328415:0:6584:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000052fff536/0x194cd781e88c8a2e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1582 expref: 7 pid: 6578 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.328429:0:6584:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000052fff536/0x194cd781e88c8a2e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1582 expref: 7 pid: 6578 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787115002.328437:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8af07f8cc380 00000100:00100000:0.0:1787115002.328468:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1 00000100:00100000:0.0:1787115002.328476:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2364:x1873925602592512:12345-192.168.202.10@tcp:4:lfs.0 00000100:00100000:0.0:1787115002.329019:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:2364:x1873925602592512:12345-192.168.202.10@tcp:4:lfs.0 Request processed in 530us (897us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787115002.329027:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1 00002000:00100000:0.0:1787115002.329035:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8af07f8cc380 x1873925602592512/t4294967302(0) o4->6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp:568/0 lens 504/448 e 0 to 0 dl 1787115013 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787115002.329043:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af07f8cc380 with x1873925602592512 ext(0->8) 00010000:00010000:0.0:1787115002.329049:0:6584:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000052fff536/0x194cd781e88c8a2e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1582 expref: 9 pid: 6578 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.329059:0:6584:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000052fff536/0x194cd781e88c8a2e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1582 expref: 9 pid: 6578 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787115002.329066:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8af07f8cc380 00000100:00100000:1.0:1787115002.329349:0:6576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eecc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6576:1873925624630144:192.168.202.10@tcp:104: 00010000:00010000:1.0:1787115002.329373:0:6576:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c8a6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115002.332216:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115002.332343:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602592640 00000100:00100000:1.0:1787115002.332353:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602592640 00010000:00010000:1.0:1787115002.332384:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000052fff536/0x194cd781e88c8a2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1582 expref: 9 pid: 6578 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115002.332442:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 50 00000100:00100000:1.0:1787115002.332451:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:2363:x1873925602592640:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787115002.332465:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787115002.332480:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787115002.332483:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787115002 00002000:00010000:1.0:1787115002.332486:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787115003 00002000:00010000:1.0:1787115002.332488:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787115002 00010000:00010000:1.0:1787115002.332493:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000052fff536/0x194cd781e88c8a2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1582 expref: 9 pid: 6578 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.332506:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000052fff536/0x194cd781e88c8a2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1582 expref: 9 pid: 6578 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.332540:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052fff536/0x194cd781e88c8a2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1582 expref: 9 pid: 6578 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.332557:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787115002.332562:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787115002.332671:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c8a6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.332681:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c8a6d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.332714:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787115002.332758:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2363:x1873925602592640:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 307us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115002.332765:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 50 00010000:00010000:0.0:1787115002.333456:0:6576:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c8a6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.333474:0:6576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c8a6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.333499:0:6576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c8a6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.333507:0:6576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c8a6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.333516:0:6576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c8a6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.333523:0:6576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1000 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787115002.333527:0:6576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c8a6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.333537:0:6576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c8a6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.333550:0:6576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c8a6d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.333558:0:6576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c8a6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115002.333695:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2362:x1873925602592384:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 8879us (9061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115002.333703:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 36 00000100:00100000:3.0:1787115002.336752:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115002.337491:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602592896 00000100:00100000:2.0:1787115002.337502:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602592896 00000100:00100000:2.0:1787115002.337554:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 26 00000100:00100000:2.0:1787115002.337645:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af066348450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+38:10503:x1873925602592896:12345-192.168.202.10@tcp:35:lfs.0 00000004:00010000:2.0:1787115002.337706:0:5788:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8a5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1597 expref: 38 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787115002.338399:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1787115002.338457:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1787115002.339483:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1787115002.339550:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a74 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.339636:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8a19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1574 expref: 42 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.339644:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a74 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.339672:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8a19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1574 expref: 42 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.339683:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8a19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1574 expref: 42 pid: 7216 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115002.339708:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f199180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5788:1873925624630272:192.168.202.10@tcp:104: 00000100:00100000:2.0:1787115002.339820:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5fab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787115002.341905:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115002.341934:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f199180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5788:1873925624630272:192.168.202.10@tcp:104: 00010000:00010000:2.0:1787115002.341959:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a74 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115002.342016:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602593024 00000100:00100000:1.0:1787115002.342023:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602593024 00010000:00010000:1.0:1787115002.342054:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8a19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1574 expref: 43 pid: 7216 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115002.342094:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 51 00000100:00100000:1.0:1787115002.342103:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+43:2363:x1873925602593024:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787115002.342138:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787115002.342146:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8a19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1574 expref: 43 pid: 7216 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.342187:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8a19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1574 expref: 43 pid: 7216 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.342208:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8a19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1574 expref: 43 pid: 7216 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.342226:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af0514c6800) 00010000:00010000:1.0:1787115002.342231:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a74 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.342239:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.342247:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a74 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.342312:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787115002.342365:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+42:2363:x1873925602593024:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 263us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115002.342384:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 51 00010000:00010000:3.0:1787115002.342880:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.342889:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787115002.342992:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1787115002.343417:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1787115002.343519:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739edc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5788:1873925624630400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787115002.343632:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115002.343662:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045be1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787115002.343728:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624630400 00000100:00100000:2.0:1787115002.343733:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624630400 00000100:00100000:2.0:1787115002.343793:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787115002.343800:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5788:x1873925624630400:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787115002.343861:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5788:x1873925624630400:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 61us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115002.343868:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787115002.343992:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787115002.344027:0:5788:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1787115002.344033:0:5788:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1787115002.344047:0:5788:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8af06ef78a80, transno 4294967301 00000100:00100000:3.0:1787115002.344069:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739edc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5788:1873925624630400:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787115002.344559:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1787115002.344608:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739edc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5788:1873925624630528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787115002.344636:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115002.344659:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045be19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787115002.345141:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624630528 00000100:00100000:2.0:1787115002.345147:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624630528 00000100:00100000:2.0:1787115002.345187:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787115002.345195:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5788:x1873925624630528:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787115002.345340:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5788:x1873925624630528:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 145us (702us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787115002.345348:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787115002.345753:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739edc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5788:1873925624630528:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787115002.345808:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1787115002.345844:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.345854:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a74 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.345863:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a74 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.345869:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115002.345874:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a74 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.345883:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a74 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.345897:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af0514c6800) 00010000:00010000:3.0:1787115002.345900:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787115002.345905:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a74 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.345912:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a74 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787115002.346075:0:5788:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787115002.346319:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1787115002.346330:0:5788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 331332222176ns, next at 332332220304ns, rc = 0 00000001:00080000:3.0:1787115002.346337:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1787115002.346367:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af0514c6800) 00010000:00010000:3.0:1787115002.346371:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787115002.346378:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8a5f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1597 expref: 46 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115002.346512:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af066348450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+45:10503:x1873925602592896:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 8949us (9766us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1787115002.346521:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 26 00000020:00080000:3.0:1787115002.346525:0:5788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787115002.351169:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115002.351278:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602593152 00000100:00100000:0.0:1787115002.351289:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602593152 00000100:00100000:0.0:1787115002.351428:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 100 00000100:00100000:0.0:1787115002.351437:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+45:10503:x1873925602593152:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1787115002.351458:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115002.351476:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8a7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d159e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.351524:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8a7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d159e expref: 46 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.351535:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8a7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d159e expref: 46 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.351549:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:0.0:1787115002.351552:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787115002.351554:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030e00, rc 0) 00000100:00100000:0.0:1787115002.351621:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+46:10503:x1873925602593152:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 184us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115002.351627:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 100 00000100:00100000:3.0:1787115002.354804:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115002.355032:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602593408 00000100:00100000:1.0:1787115002.355045:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602593408 00000100:00100000:1.0:1787115002.355144:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 27 00000100:00100000:1.0:1787115002.355154:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+46:10503:x1873925602593408:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:1.0:1787115002.355508:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+47:10503:x1873925602593408:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 355us (714us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1787115002.355527:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 27 00000100:00100000:3.0:1787115002.469035:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115002.469720:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602593536 00000100:00100000:1.0:1787115002.469732:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602593536 00000100:00100000:0.0:1787115002.470195:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 101 00000100:00100000:0.0:1787115002.470207:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+47:10513:x1873925602593536:12345-192.168.202.10@tcp:34:lfs.0 00010000:00010000:0.0:1787115002.470296:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8a82 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470313:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8a82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470324:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8a82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470340:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8a89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470347:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8a89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470354:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8a89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470449:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8a90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470457:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8a90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470465:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8a90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787115002.470502:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8a90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470515:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8a82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470530:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8a82 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470536:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8a82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470542:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040031000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115002.470546:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8a82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470554:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8a82 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470704:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:0.0:1787115002.470707:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115002.470712:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8a82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470719:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8a82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470732:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8a89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470738:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8a89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470744:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8a89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470748:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030a00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115002.470756:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8a89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470763:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8a89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470769:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8af051ecbd00) 00010000:00010000:0.0:1787115002.470771:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115002.470774:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8a89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470790:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8a89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470804:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8a90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470811:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8a90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470816:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8a90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470820:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115002.470823:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8a90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470835:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8a90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470841:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:0.0:1787115002.470843:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115002.470850:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8a90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.470857:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8a90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115002.470927:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+47:10513:x1873925602593536:12345-192.168.202.10@tcp:34:lfs.0 Request processed in 723us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115002.470935:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 101 00000100:00100000:0.0:1787115002.505363:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115002.505496:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602593792 00000100:00100000:2.0:1787115002.505507:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602593792 00000100:00100000:2.0:1787115002.505567:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 102 00000100:00100000:2.0:1787115002.505577:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+47:10516:x1873925602593792:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1787115002.505613:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115002.505635:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8a97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d15a5 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.505705:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a9e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.505720:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.505732:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.505747:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8aa5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.505754:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.505760:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.505999:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8aac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.506020:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8aac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.506027:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8aac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115002.506037:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787115002.506480:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.506489:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a9e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.506497:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.506503:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115002.506507:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.506514:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a9e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.506527:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:3.0:1787115002.506537:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115002.506542:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.506548:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8a9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.506564:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.506570:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8aa5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.506575:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.506580:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115002.506583:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.506589:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8aa5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.506596:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8af0514c6a00) 00010000:00010000:3.0:1787115002.506599:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115002.506601:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8aa5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.506607:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8aa5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.506647:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8a97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15a5 expref: 50 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.506675:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8aac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15a5 expref: 49 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.506682:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:3.0:1787115002.506685:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787115002.506687:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216f800, rc 0) 00000100:00100000:3.0:1787115002.506806:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+49:10516:x1873925602593792:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1230us (1451us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787115002.506815:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 102 00000100:00100000:3.0:1787115002.513724:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115002.514090:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602593920 00000100:00100000:2.0:1787115002.514100:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602593920 00000100:00100000:2.0:1787115002.514178:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 103 00000100:00100000:2.0:1787115002.514188:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+49:10516:x1873925602593920:12345-192.168.202.10@tcp:54:lfs.0 00010000:00010000:2.0:1787115002.514252:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8aba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.514270:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.514349:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.514429:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.514437:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8aba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.514444:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8aba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.514451:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216fa00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115002.514455:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8aba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.514462:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8aba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.514474:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:2.0:1787115002.514477:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787115002.514481:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8aba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.514505:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8aba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115002.514575:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+49:10516:x1873925602593920:12345-192.168.202.10@tcp:54:lfs.0 Request processed in 388us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115002.514583:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 103 00000100:00100000:0.0:1787115002.519524:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115002.519620:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602594176 00000100:00100000:3.0:1787115002.519630:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602594176 00000100:00100000:3.0:1787115002.519690:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 28 00000100:00100000:3.0:1787115002.519702:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+49:10516:x1873925602594176:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:3.0:1787115002.521690:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+50:10516:x1873925602594176:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 1984us (2170us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787115002.521702:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 28 00000100:00100000:0.0:1787115002.670243:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115002.670343:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602594432 00000100:00100000:2.0:1787115002.670354:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602594432 00000100:00100000:2.0:1787115002.670412:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 104 00000100:00100000:2.0:1787115002.670422:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+50:10526:x1873925602594432:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:2.0:1787115002.670615:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115002.670619:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787115002.670644:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8a3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1589 expref: 50 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.670666:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:2.0:1787115002.670671:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787115002.670685:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8ac1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d15ac expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.671056:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8ac8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.671071:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.671081:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115002.671183:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787115002.671314:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8ac1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15ac expref: 52 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.671331:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15ac expref: 51 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.671338:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:2.0:1787115002.671341:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787115002.671343:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216e800, rc 0) 00000100:00100000:2.0:1787115002.671409:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+51:10526:x1873925602594432:12345-192.168.202.10@tcp:101:bash.0 Request processed in 988us (1174us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787115002.671416:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 104 00000100:00100000:2.0:1787115002.680192:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115002.680282:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602594688 00000100:00100000:0.0:1787115002.680292:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602594688 00000100:00100000:0.0:1787115002.680350:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 105 00000100:00100000:0.0:1787115002.680359:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+51:10526:x1873925602594688:12345-192.168.202.10@tcp:36:bash.0 00010000:00010000:0.0:1787115002.680416:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787115002.680440:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8ac8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15ac expref: 51 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.680462:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8aac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15a5 expref: 50 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.680473:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:0.0:1787115002.680477:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787115002.680687:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8ad6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.680701:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.680723:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787115002.680770:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1787115002.680793:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002088244b reply state 0000000055a6ae74 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115002.680801:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787115002.680888:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+52:10526:x1873925602594688:12345-192.168.202.10@tcp:36:bash.0 Request processed in 530us (707us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787115002.680895:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 105 00000020:00080000:0.0:1787115002.680899:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787115002.685524:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115002.685757:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602594816 00000100:00100000:1.0:1787115002.685767:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602594816 00000100:00100000:1.0:1787115002.685820:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 106 00000100:00100000:1.0:1787115002.685830:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+52:10526:x1873925602594816:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:1.0:1787115002.685853:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115002.685873:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c8add lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d15b3 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.685944:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8ae4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.685957:0:7216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8ad6 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.685965:0:7216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8ae4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.685980:0:7216:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.685990:0:7216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8ae4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.686135:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.686144:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8ad6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.686152:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8ad6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.686158:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115002.686181:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8ad6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.686189:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8ad6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.686203:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:3.0:1787115002.686206:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115002.686209:0:3292:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8ae4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.686217:0:3292:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.686223:0:3292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8ae4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.686248:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8ad6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.686254:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8ad6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.686273:0:7216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.686282:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787115002.686321:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787115002.686326:0:7216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787115002.686346:0:7216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.686370:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c8add lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15b3 expref: 53 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.686383:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15b3 expref: 52 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.686390:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:1.0:1787115002.686393:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787115002.686395:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0000, rc 0) 00000100:00100000:1.0:1787115002.686527:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+52:10526:x1873925602594816:12345-192.168.202.10@tcp:101:bash.0 Request processed in 698us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115002.686535:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 106 00000100:00100000:1.0:1787115002.689276:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115002.689338:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602595072 00000100:00100000:0.0:1787115002.689347:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602595072 00000100:00100000:0.0:1787115002.689394:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 29 00000100:00100000:0.0:1787115002.689403:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+52:10526:x1873925602595072:12345-192.168.202.10@tcp:35:bash.0 00000100:00100000:0.0:1787115002.690548:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+53:10526:x1873925602595072:12345-192.168.202.10@tcp:35:bash.0 Request processed in 1142us (1273us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1787115002.690559:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 29 00000100:00100000:2.0:1787115002.768165:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115002.768260:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602595200 00000100:00100000:0.0:1787115002.768272:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602595200 00000100:00100000:0.0:1787115002.768385:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 107 00000100:00100000:0.0:1787115002.768396:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f19b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+53:10532:x1873925602595200:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1787115002.768422:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115002.768443:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8aeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d15ba expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.768556:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8af2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.768581:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8af2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.768594:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8af2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115002.768653:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787115002.768657:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787115002.768680:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8af2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.768705:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8aeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15ba expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.768723:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8af2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15ba expref: 54 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115002.768732:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:0.0:1787115002.768735:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787115002.768739:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030c00, rc 0) 00000100:00100000:0.0:1787115002.768818:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f19b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+54:10532:x1873925602595200:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 423us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115002.768824:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 107 00000100:00100000:3.0:1787115002.775325:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115002.787900:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602595328 00000100:00100000:2.0:1787115002.787929:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602595328 00000100:00100000:2.0:1787115002.788027:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 108 00000100:00100000:2.0:1787115002.788039:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+54:10532:x1873925602595328:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1787115002.788064:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115002.788088:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8af9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d15c1 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788170:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8b00 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788185:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8b00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788210:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8b00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788228:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8b07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788236:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788242:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788353:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8b0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788362:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8b0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788368:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8b0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115002.788413:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787115002.788417:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787115002.788436:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8b0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788446:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8b0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788466:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8b00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788481:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8b00 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788487:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8b00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788493:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115002.788497:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8b00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788504:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8b00 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788515:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:2.0:1787115002.788518:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115002.788522:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8b00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788528:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8b00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788543:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788549:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8b07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788555:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788560:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216f200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115002.788577:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788584:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8b07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788592:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8af0514c6d00) 00010000:00010000:2.0:1787115002.788595:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115002.788598:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8b07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788604:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8b07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788638:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8af9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15c1 expref: 56 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788651:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8b0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15c1 expref: 55 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.788658:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:2.0:1787115002.788661:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787115002.788663:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216fa00, rc 0) 00000100:00100000:2.0:1787115002.788746:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+55:10532:x1873925602595328:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 708us (13432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115002.788753:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 108 00000100:00100000:3.0:1787115002.793771:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115002.793951:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602595456 00000100:00100000:2.0:1787115002.793961:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602595456 00000100:00100000:2.0:1787115002.794030:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:2.0:1787115002.794038:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+55:2363:x1873925602595456:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115002.794066:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115002.794089:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8b0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15c1 expref: 55 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.794128:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:2.0:1787115002.794134:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115002.794180:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+54:2363:x1873925602595456:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 142us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115002.794187:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:2.0:1787115002.796804:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115002.797351:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602595712 00000100:00100000:3.0:1787115002.797361:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602595712 00000100:00100000:3.0:1787115002.797418:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 109 00000100:00100000:3.0:1787115002.797427:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+54:10532:x1873925602595712:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1787115002.797445:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115002.797476:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8b15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d15c8 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.797584:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c8b1c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.797600:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8ae4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15b3 expref: 55 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.797608:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c8b1c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.797642:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15b3 expref: 55 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.797656:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15b3 expref: 55 pid: 7216 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115002.797671:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1873925624630656:192.168.202.10@tcp:104: 00000100:00100000:3.0:1787115002.797759:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045be16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787115002.805398:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115002.805525:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1873925624630656:192.168.202.10@tcp:104: 00000100:00100000:1.0:1787115002.805526:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602595840 00000100:00100000:1.0:1787115002.805532:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602595840 00010000:00010000:1.0:1787115002.805567:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15b3 expref: 56 pid: 7216 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.805569:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c8b1c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115002.805618:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 52 00000100:00100000:1.0:1787115002.805628:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+56:2364:x1873925602595840:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787115002.805644:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787115002.805650:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15b3 expref: 56 pid: 7216 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.805677:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15b3 expref: 56 pid: 7216 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.805699:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8ae4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15b3 expref: 56 pid: 7216 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.805714:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:1.0:1787115002.805718:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c8b1c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.805727:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c8b1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.805734:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c8b1c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.805761:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787115002.805883:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+55:2364:x1873925602595840:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 256us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115002.805891:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 52 00010000:00010000:3.0:1787115002.805974:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c8b1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.805981:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c8b1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787115002.805999:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787115002.806347:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8b15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15c8 expref: 56 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.806376:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c8b1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15c8 expref: 55 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115002.806384:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:3.0:1787115002.806386:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787115002.806389:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429ca600, rc 0) 00000100:00100000:3.0:1787115002.806415:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+55:10532:x1873925602595712:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 8990us (9619us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1787115002.806421:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 109 00000100:00100000:0.0:1787115002.813663:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115002.813725:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602596096 00000100:00100000:2.0:1787115002.813735:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602596096 00000100:00100000:2.0:1787115002.813801:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:2.0:1787115002.813822:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+55:10532:x1873925602596096:12345-192.168.202.10@tcp:103:lfs.0 00010000:00010000:2.0:1787115002.813838:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115002.813862:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8a7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d159e expref: 55 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.813880:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:2.0:1787115002.813885:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115002.813946:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+54:10532:x1873925602596096:12345-192.168.202.10@tcp:103:lfs.0 Request processed in 127us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115002.813971:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:0.0:1787115002.824461:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115002.824670:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602596224 00000100:00100000:2.0:1787115002.824679:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602596224 00000100:00100000:2.0:1787115002.824725:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 110 00000100:00100000:2.0:1787115002.824733:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+54:10532:x1873925602596224:12345-192.168.202.10@tcp:58:lfs.0 00010000:00010000:2.0:1787115002.824839:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8b2a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.824858:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8b2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115002.824870:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8b2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787115002.825066:0:7216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787115002.825323:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+54:10532:x1873925602596224:12345-192.168.202.10@tcp:58:lfs.0 Request processed in 588us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115002.825331:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 110 00000100:00100000:0.0:1787115002.835673:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115002.835863:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602596352 00000100:00100000:1.0:1787115002.835874:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602596352 00000100:00100000:1.0:1787115002.835940:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 111 00000100:00100000:1.0:1787115002.835951:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+54:10532:x1873925602596352:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1787115002.835971:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115002.835992:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8b31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d15cf expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.836080:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8b2a lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.836092:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8b31 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15cf expref: 55 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.836149:0:5787:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8b2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.836163:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8b31 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15cf expref: 55 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.836189:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:1.0:1787115002.836192:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787115002.836196:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8b31 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15cf expref: 55 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115002.836205:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0000, rc 0) 00000100:00100000:1.0:1787115002.836258:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+55:10532:x1873925602596352:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 308us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115002.836266:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 111 00010000:00010000:3.0:1787115003.205273:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787115003.397380:0:11519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787115003.397391:0:11519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787115003.397459:0:11519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1787115003.397467:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787115003.397602:0:11519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ef100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11519:1873925624630784:192.168.202.10@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787115003.397710:0:11519:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045be1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787115003.402051:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115003.402203:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602596480 00000100:00100000:1.0:1787115003.402213:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602596480 00000100:00100000:1.0:1787115003.402294:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 112 00000100:00100000:1.0:1787115003.402304:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+56:10533:x1873925602596480:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787115003.402366:0:5786:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787115003.402478:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+56:10533:x1873925602596480:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 Request processed in 175us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115003.402485:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 112 00000100:00080000:2.0:1787115003.402606:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787115003.403755:0:11519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ef100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11519:1873925624630784:192.168.202.10@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787115003.407403:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115003.407502:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602596608 00000100:00100000:1.0:1787115003.407511:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602596608 00000100:00100000:1.0:1787115003.407568:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 113 00000100:00100000:1.0:1787115003.407578:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+55:10533:x1873925602596608:12345-192.168.202.10@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787115003.407660:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8b38 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.407678:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8b38 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.407692:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8b38 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.407757:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b3f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.407766:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.407785:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.407810:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8b46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.407820:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.407826:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787115003.407881:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787115003.407886:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787115003.407898:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.407921:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8b38 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.407928:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8b38 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.407935:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8b38 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.407943:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1a00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115003.407947:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8b38 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.407956:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8b38 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.407967:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8af0510d6d00) 00010000:00010000:1.0:1787115003.407970:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787115003.407975:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8b38 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.407980:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8b38 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.407993:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.408024:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b3f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.408029:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b3f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.408034:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1800 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115003.408037:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b3f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.408043:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b3f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.408051:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8af0510d6500) 00010000:00010000:1.0:1787115003.408053:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787115003.408056:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b3f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.408062:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b3f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.408077:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.408083:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8b46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.408089:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8b46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.408094:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115003.408103:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8b46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.408343:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8b46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.408351:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:1.0:1787115003.408354:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787115003.408357:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8b46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.408363:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8b46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115003.408450:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+55:10533:x1873925602596608:12345-192.168.202.10@tcp:34:lhsmtool_posix.0 Request processed in 872us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115003.408459:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 113 00000100:00100000:0.0:1787115003.417872:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115003.418040:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602596864 00000100:00100000:1.0:1787115003.418051:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602596864 00000100:00100000:1.0:1787115003.418138:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 114 00000100:00100000:1.0:1787115003.418150:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+55:10533:x1873925602596864:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787115003.418182:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115003.418204:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8b4d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d15d6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.418313:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.418330:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.418358:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787115003.418370:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787115003.418472:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.418480:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.418486:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.418493:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1800 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115003.418497:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.418504:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.418515:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:1.0:1787115003.418518:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787115003.418523:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.418529:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.418578:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8b4d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15d6 expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.418599:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8af0510d6d00) 00010000:00010000:1.0:1787115003.418601:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787115003.418605:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8b4d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15d6 expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.418614:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0c00, rc 0) 00000100:00100000:1.0:1787115003.418671:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+56:10533:x1873925602596864:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 524us (809us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1787115003.418678:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 114 00000100:00100000:0.0:1787115003.423840:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115003.423931:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602596992 00000100:00100000:1.0:1787115003.423944:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602596992 00000100:00100000:1.0:1787115003.424016:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 115 00000100:00100000:1.0:1787115003.424039:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+56:10533:x1873925602596992:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787115003.424078:0:5787:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787115003.424235:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+56:10533:x1873925602596992:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 Request processed in 208us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115003.424243:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 115 00000100:00100000:0.0:1787115003.433667:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115003.434478:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602597248 00000100:00100000:1.0:1787115003.434490:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602597248 00000100:00100000:1.0:1787115003.434551:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 116 00000100:00100000:1.0:1787115003.434567:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+56:10533:x1873925602597248:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787115003.434589:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115003.434592:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787115003.434617:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8af2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15ba expref: 56 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.434653:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:1.0:1787115003.434659:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787115003.434673:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8b62 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d15dd expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787115003.435804:0:5786:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1787115003.436032:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.436047:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.436058:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.436139:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8b62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15dd expref: 58 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.436156:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15dd expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.436175:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8af0510d6500) 00010000:00010000:1.0:1787115003.436178:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787115003.436181:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a1800, rc 0) 00000100:00100000:1.0:1787115003.436254:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+57:10533:x1873925602597248:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 1694us (2595us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787115003.436262:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 116 00000100:00100000:0.0:1787115003.448097:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115003.450030:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602597504 00000100:00100000:1.0:1787115003.450044:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602597504 00000100:00100000:1.0:1787115003.450102:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 117 00000100:00100000:1.0:1787115003.450129:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+57:10533:x1873925602597504:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787115003.450206:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787115003.450237:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8b69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15dd expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.450260:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8af0510d6500) 00010000:00010000:1.0:1787115003.450272:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787115003.450294:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8b77 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.450308:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8b77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.450319:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8b77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.450357:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8b7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xcf6ad2a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.450364:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8b7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcf6ad2a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.450371:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8b7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcf6ad2a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.450452:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8b77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.450477:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8b77 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.450483:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8b77 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.450490:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1a00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115003.450494:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8b77 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.450502:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8b77 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.450511:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:1.0:1787115003.450514:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787115003.450517:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8b77 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.450522:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8b77 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.450531:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8b7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcf6ad2a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.450536:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8b7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcf6ad2a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.450541:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8b7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcf6ad2a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.450546:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115003.450555:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8b7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcf6ad2a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.450574:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8b7e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcf6ad2a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.450581:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xcf6ad2a8 (ffff8af0510d6600) 00010000:00010000:1.0:1787115003.450583:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787115003.450586:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8b7e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xcf6ad2a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.450591:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8b7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xcf6ad2a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115003.450674:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+56:10533:x1873925602597504:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 Request processed in 547us (2587us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787115003.450682:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 117 00000100:00100000:0.0:1787115003.463315:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115003.463403:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602597632 00000100:00100000:2.0:1787115003.463414:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602597632 00000100:00100000:2.0:1787115003.463471:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 118 00000100:00100000:2.0:1787115003.463482:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+56:10533:x1873925602597632:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787115003.463506:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115003.463532:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8b85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d15e4 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.463570:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8b8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.463598:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8b8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.463610:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8b8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.463707:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8b85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15e4 expref: 58 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.463729:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8b8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15e4 expref: 57 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.463739:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:2.0:1787115003.463742:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787115003.463746:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216f200, rc 0) 00000100:00100000:2.0:1787115003.463808:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+57:10533:x1873925602597632:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 328us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115003.463816:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 118 00000100:00100000:0.0:1787115003.471796:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115003.471896:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602597888 00000100:00100000:1.0:1787115003.471916:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602597888 00000100:00100000:1.0:1787115003.471972:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 119 00000100:00100000:1.0:1787115003.471981:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+57:10533:x1873925602597888:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787115003.472092:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8b93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.472147:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8b93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.472160:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8b93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787115003.472418:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1787115003.472440:0:5787:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332458331586ns, next at 333458329498ns, rc = 0 00000004:00010000:1.0:1787115003.472529:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000632d14bb reply state 00000000bdb2c62d transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8b93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115003.472539:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787115003.472622:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+59:10533:x1873925602597888:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 Request processed in 641us (834us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1787115003.472630:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 119 00010000:00010000:2.0:1787115003.477733:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8b93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.477751:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8b93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.477758:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8b93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.477764:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115003.477769:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8b93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.477793:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8b93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.477810:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:2.0:1787115003.477814:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787115003.477818:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8b93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.477825:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8b93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115003.479248:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115003.479449:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602598016 00000100:00100000:2.0:1787115003.479460:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602598016 00000100:00100000:2.0:1787115003.479506:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 120 00000100:00100000:2.0:1787115003.479516:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+58:10533:x1873925602598016:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787115003.479540:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115003.479571:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8b9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d15eb expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.479631:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8b9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15eb expref: 59 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.479645:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8b9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15eb expref: 59 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.479665:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:2.0:1787115003.479668:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787115003.479672:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216e600, rc 0) 00000100:00100000:2.0:1787115003.479743:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+59:10533:x1873925602598016:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 228us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115003.479750:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 120 00000100:00100000:0.0:1787115003.491527:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115003.492589:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602598144 00000100:00100000:2.0:1787115003.492601:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602598144 00000100:00100000:2.0:1787115003.492676:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 37 00000100:00100000:2.0:1787115003.492688:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2363:x1873925602598144:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787115003.493006:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:2363:x1873925602598144:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 Request processed in 310us (1477us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787115003.493014:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 37 00000100:00080000:3.0:1787115003.494435:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787115003.500243:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115003.500345:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602598400 00000100:00100000:1.0:1787115003.500356:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602598400 00000100:00100000:1.0:1787115003.500417:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 30 00000100:00100000:1.0:1787115003.500428:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+59:10533:x1873925602598400:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787115003.500691:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+60:10533:x1873925602598400:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 Request processed in 264us (462us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1787115003.500700:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 30 00000100:00100000:0.0:1787115003.516516:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115003.516883:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602598656 00000100:00100000:1.0:1787115003.516893:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602598656 00000100:00100000:1.0:1787115003.516961:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 121 00000100:00100000:1.0:1787115003.516971:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+60:10533:x1873925602598656:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787115003.517158:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+60:10533:x1873925602598656:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 Request processed in 188us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115003.517177:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 121 00000100:00100000:0.0:1787115003.542641:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115003.542757:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602598784 00000100:00100000:2.0:1787115003.542767:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602598784 00000100:00100000:2.0:1787115003.542836:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 122 00000100:00100000:2.0:1787115003.542854:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+60:10533:x1873925602598784:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787115003.542876:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115003.542898:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8ba1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d15f2 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.542979:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8ba8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.542994:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.543018:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115003.543054:0:7216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787115003.543090:0:7216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.543158:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8ba1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15f2 expref: 62 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.543191:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15f2 expref: 61 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.543201:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:2.0:1787115003.543205:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787115003.543209:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216e800, rc 0) 00000100:00100000:2.0:1787115003.543267:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+61:10533:x1873925602598784:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 422us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115003.543274:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 122 00000100:00100000:0.0:1787115003.551534:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115003.551620:0:11535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602598912 00000100:00100000:3.0:1787115003.551631:0:11535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602598912 00000100:00100000:3.0:1787115003.551687:0:11535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 38 00000100:00100000:3.0:1787115003.551697:0:11535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:2364:x1873925602598912:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787115003.551715:0:11535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115003.551735:0:11535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030a02baf/0x194cd781e88c8baf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d15f9 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787115003.551779:0:11535:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8535fc, blocks: 0x1 00010000:00010000:3.0:1787115003.551799:0:11535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=332s v=(0 0) 00010000:00010000:3.0:1787115003.551804:0:11535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115003.551812:0:11535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030a02baf/0x194cd781e88c8baf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15f9 expref: 10 pid: 11535 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.551829:0:11535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030a02baf/0x194cd781e88c8baf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15f9 expref: 10 pid: 11535 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.551844:0:11535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429cba00, rc 0) 00000100:00100000:3.0:1787115003.551917:0:11535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+10:2364:x1873925602598912:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 221us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115003.551925:0:11535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 38 00000100:00100000:0.0:1787115003.560700:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115003.560814:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602599168 00000100:00100000:1.0:1787115003.560825:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602599168 00000100:00100000:1.0:1787115003.560892:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 123 00000100:00100000:1.0:1787115003.560903:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+61:10533:x1873925602599168:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787115003.561057:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+61:10533:x1873925602599168:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 Request processed in 155us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115003.561065:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 123 00000100:00100000:1.0:1787115003.568516:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115003.568610:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602599296 00000100:00100000:3.0:1787115003.568620:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602599296 00000100:00100000:3.0:1787115003.568682:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 39 00000100:00100000:3.0:1787115003.568692:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+10:10533:x1873925602599296:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787115003.568713:0:6578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115003.568744:0:6578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c8bb6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1600 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.569034:0:6578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030a02baf/0x194cd781e88c8baf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15f9 expref: 11 pid: 11535 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.569065:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115003.569070:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115003.569076:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c8bb6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1600 expref: 11 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.569270:0:6578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030a02baf/0x194cd781e88c8baf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15f9 expref: 11 pid: 11535 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.569287:0:6578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030a02baf/0x194cd781e88c8baf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15f9 expref: 11 pid: 11535 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115003.569302:0:6578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6578:1873925624630912:192.168.202.10@tcp:104: 00000100:00100000:2.0:1787115003.569779:0:6578:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045be1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787115003.578386:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115003.578738:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602599424 00000100:00100000:1.0:1787115003.578748:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602599424 00010000:00010000:1.0:1787115003.578800:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030a02baf/0x194cd781e88c8baf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15f9 expref: 12 pid: 11535 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115003.578846:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 53 00000100:00100000:1.0:1787115003.578855:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+12:2364:x1873925602599424:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787115003.578871:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787115003.578894:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030a02baf/0x194cd781e88c8baf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15f9 expref: 12 pid: 11535 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.578920:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030a02baf/0x194cd781e88c8baf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15f9 expref: 12 pid: 11535 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.578945:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787115003.578949:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787115003.578957:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c8bb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1600 expref: 12 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.578968:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c8bb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1600 expref: 12 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.579032:0:5772:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c8bb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1600 expref: 12 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115003.579048:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eecc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5772:1873925624631040:192.168.202.10@tcp:105: 00000100:00100000:1.0:1787115003.579171:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050747b40 going to sleep for 11 seconds 00010000:00010000:2.0:1787115003.581585:0:6578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030a02baf/0x194cd781e88c8baf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15f9 expref: 12 pid: 11535 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115003.581611:0:6578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6578:1873925624630912:192.168.202.10@tcp:104: 00010000:00010000:2.0:1787115003.581640:0:6578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c8bb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1600 expref: 11 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.581655:0:6578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429ca000, rc 0) 00000100:00100000:2.0:1787115003.581721:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+11:10533:x1873925602599296:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 13029us (13214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115003.581729:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 39 00000100:00100000:1.0:1787115003.586666:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eecc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5772:1873925624631040:192.168.202.10@tcp:105: 00010000:00010000:1.0:1787115003.586699:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787115003.586783:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+10:2364:x1873925602599424:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 7921us (8399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115003.586795:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 53 00000100:00100000:3.0:1787115003.588347:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115003.591034:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602599552 00000100:00100000:1.0:1787115003.591051:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602599552 00002000:00100000:1.0:1787115003.591134:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8af0739ece00 x1873925602599552/t0(0) o4->6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp:569/0 lens 504/0 e 0 to 0 dl 1787115014 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787115003.591147:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af0739ece00 with x1873925602599552 ext(0->12) 00002000:00010000:1.0:1787115003.591153:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af0739ece00 00000100:00100000:1.0:1787115003.591195:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 2 00000100:00100000:1.0:1787115003.591205:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+10:2364:x1873925602599552:12345-192.168.202.10@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787115003.591954:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+12:2364:x1873925602599552:12345-192.168.202.10@tcp:4:lhsmtool_posix.0 Request processed in 749us (3611us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787115003.591964:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 2 00002000:00100000:1.0:1787115003.591971:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8af0739ece00 x1873925602599552/t4294967308(0) o4->6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp:569/0 lens 504/448 e 0 to 0 dl 1787115014 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787115003.591992:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af0739ece00 with x1873925602599552 ext(0->12) 00002000:00010000:1.0:1787115003.592005:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af0739ece00 00000100:00100000:3.0:1787115003.603637:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115003.603825:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602599680 00000100:00100000:2.0:1787115003.603840:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602599680 00000100:00100000:2.0:1787115003.603926:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 124 00000100:00100000:2.0:1787115003.603940:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+61:10533:x1873925602599680:12345-192.168.202.10@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787115003.757263:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967395 is committed 00000001:00080000:2.0:1787115003.757341:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1787115003.757350:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:2.0:1787115003.757574:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f19b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624631168:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787115003.757678:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115003.757775:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787115003.757782:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624631296:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787115003.757812:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115003.757859:0:11535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624631168 00000100:00100000:2.0:1787115003.757868:0:11535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624631168 00000100:00100000:2.0:1787115003.757934:0:11535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624631296 00000100:00100000:2.0:1787115003.757937:0:11535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624631296 00000100:00100000:2.0:1787115003.757960:0:11535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787115003.757969:0:11535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f199f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1873925624631168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787115003.758021:0:11535:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1787115003.758055:0:11535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086a00f72/0x194cd781e88c8bbd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.758083:0:11535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d482cf92/0x194cd781e88c897f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d155f expref: 11 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.758095:0:11535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787115003.758101:0:11535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787115003.758152:0:11535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086a00f72/0x194cd781e88c8bbd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.758192:0:11535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d482cf92/0x194cd781e88c897f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d155f expref: 11 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.758211:0:11535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d482cf92/0x194cd781e88c897f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d155f expref: 11 pid: 6578 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115003.758225:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f19aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11535:1873925624631424:192.168.202.10@tcp:104: 00000100:00100000:2.0:1787115003.758314:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5fa180 going to sleep for 11 seconds 00000100:00100000:2.0:1787115003.758334:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787115003.758343:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1873925624631296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787115003.758529:0:6576:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787115003.758533:0:6576:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787115004 00002000:00010000:2.0:1787115003.758536:0:6576:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787115003.758538:0:6576:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787115004 -> 1787115004 00002000:00010000:2.0:1787115003.758541:0:6576:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787115003.758593:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3306:x1873925624631296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 250us (779us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787115003.758601:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1787115003.758627:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787115003.758666:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8af06f198e00/2, rc 0, transno 4294967309 00000100:00100000:2.0:1787115003.758673:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624631296:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787115003.758813:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+45:10533:x1873925602599680:12345-192.168.202.10@tcp:44:lhsmtool_posix.0 Request processed in 154876us (155186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115003.758832:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 124 00000004:00080000:1.0:1787115003.760633:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787115003.760692:0:5807:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8af06f5f0b40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787115003.760699:0:5807:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af06f1b3e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8af06f5f0300 00000020:00080000:1.0:1787115003.760703:0:5807:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af06f1b3300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af06f19cc00 00000004:00080000:1.0:1787115003.760741:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787115003.760768:0:5807:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8af045be1a80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787115003.760777:0:5807:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af048a38400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8af045be1d80 00000020:00080000:1.0:1787115003.760780:0:5807:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af048a38d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af050d78400 00000020:00080000:0.0:1787115003.760984:0:5818:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787115003.761316:0:5818:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787115003.762129:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787115003.762154:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624631552:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787115003.762245:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115003.762304:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624631552 00000100:00100000:3.0:1787115003.762882:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624631552 00000100:00100000:3.0:1787115003.763082:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787115003.763094:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1873925624631552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787115003.763899:0:6576:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1787115003.763960:0:6576:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8535fa, atime: 0x6a8535fb, ctime: 0x6a8535fa, blocks: 0x1 00010000:00010000:3.0:1787115003.763970:0:6576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e72b9f81/0x194cd781e88c8bc4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.764018:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=332s v=(0 0) 00010000:00010000:3.0:1787115003.764024:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115003.764033:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e72b9f81/0x194cd781e88c8bc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.764053:0:6576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e72b9f81/0x194cd781e88c8bc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.764066:0:6576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e72b9f81/0x194cd781e88c8bc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.764075:0:6576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e72b9f81/0x194cd781e88c8bc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.764098:0:6576:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787115003.764365:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115003.764577:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115003.764639:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f19aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11535:1873925624631424:192.168.202.10@tcp:104: 00010000:00010000:0.0:1787115003.764670:0:11535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000086a00f72/0x194cd781e88c8bbd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115003.764702:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602599808 00000100:00100000:0.0:1787115003.764708:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602599808 00010000:00010000:0.0:1787115003.764745:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d482cf92/0x194cd781e88c897f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d155f expref: 12 pid: 6578 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115003.764849:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 54 00000100:00100000:0.0:1787115003.764860:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+12:2364:x1873925602599808:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787115003.764873:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787115003.764880:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d482cf92/0x194cd781e88c897f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d155f expref: 12 pid: 6578 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.764895:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d482cf92/0x194cd781e88c897f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d155f expref: 12 pid: 6578 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.764921:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d482cf92/0x194cd781e88c897f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d155f expref: 12 pid: 6578 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.764940:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787115003.764944:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787115003.764951:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000086a00f72/0x194cd781e88c8bbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.764961:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086a00f72/0x194cd781e88c8bbd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.764987:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787115003.765057:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+11:2364:x1873925602599808:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 199us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115003.765074:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 54 00010000:00010000:1.0:1787115003.765346:0:8290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787115003.765356:0:8290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e72b9f81/0x194cd781e88c8bc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.765366:0:8290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cae00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:1.0:1787115003.765371:0:8290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e72b9f81/0x194cd781e88c8bc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.765381:0:8290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e72b9f81/0x194cd781e88c8bc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.765556:0:8290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e72b9f81/0x194cd781e88c8bc4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.765576:0:8290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e72b9f81/0x194cd781e88c8bc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.765600:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115003.765603:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115003.765605:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115003.767692:0:11535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000086a00f72/0x194cd781e88c8bbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.767717:0:11535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086a00f72/0x194cd781e88c8bbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.767730:0:11535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086a00f72/0x194cd781e88c8bbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.767739:0:11535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086a00f72/0x194cd781e88c8bbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.767758:0:11535:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787115003.769052:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787115003.769072:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00010000:1.0:1787115003.769569:0:8291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787115003.769581:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086a00f72/0x194cd781e88c8bbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.769594:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e200 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:1.0:1787115003.769600:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086a00f72/0x194cd781e88c8bbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.769611:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086a00f72/0x194cd781e88c8bbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.769638:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086a00f72/0x194cd781e88c8bbd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.769648:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086a00f72/0x194cd781e88c8bbd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.769677:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115003.769679:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115003.769681:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787115003.771909:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602599936 00000100:00100000:2.0:1787115003.771927:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602599936 00000100:00100000:1.0:1787115003.772610:0:11900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 43 00000100:00100000:1.0:1787115003.772625:0:11900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6aef9ffe-3b7b-498c-9a5a-a012c6970297+11:2364:x1873925602599936:12345-192.168.202.10@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787115003.776568:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1873925624631552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13461us (14307us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787115003.776587:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:3.0:1787115003.776666:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8af0739eea00/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787115003.776674:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624631552:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787115003.776787:0:11535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f199f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3306:x1873925624631168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18817us (19109us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787115003.776797:0:11535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:1.0:1787115003.794817:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8af06f19b100/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787115003.794840:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f19b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624631168:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1787115003.846364:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1787115003.846597:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1787115003.846762:0:11900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602599936:12345-192.168.202.10@tcp:16:lhsmtool_posix.0 Request processed in 74131us (82176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115003.849871:0:11900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 43 00000100:00100000:0.0:1787115003.851753:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115003.852571:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602600192 00000100:00100000:1.0:1787115003.852587:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602600192 00000100:00100000:1.0:1787115003.852665:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 125 00000100:00100000:1.0:1787115003.852677:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+15:10533:x1873925602600192:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787115003.852755:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787115003.852804:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8ba8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15f2 expref: 15 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.852833:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:1.0:1787115003.852839:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787115003.852881:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bcb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.852897:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.852908:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787115003.853319:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e86f9696 reply state 00000000b1ccc1d2 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115003.853331:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787115003.853743:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+16:10533:x1873925602600192:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 Request processed in 1065us (1996us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787115003.853775:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 125 00010000:00010000:0.0:1787115003.856820:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.856844:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bcb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.856853:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bcb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.856861:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115003.856884:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bcb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.856894:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bcb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.856915:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:0.0:1787115003.856919:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115003.856925:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bcb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.856932:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bcb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115003.861046:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115003.861744:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602600320 00000100:00100000:2.0:1787115003.861758:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602600320 00000100:00100000:2.0:1787115003.861844:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 44 00000100:00100000:2.0:1787115003.861855:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2363:x1873925602600320:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787115003.862547:0:6577:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787115003.862553:0:6577:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787115004 -> 1787115003 00002000:00010000:2.0:1787115003.862555:0:6577:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787115003 00002000:00010000:2.0:1787115003.862557:0:6577:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787115004 -> 1787115003 00002000:00010000:2.0:1787115003.862560:0:6577:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787115003.862635:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2363:x1873925602600320:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 Request processed in 781us (1604us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787115003.862645:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 44 00000100:00100000:3.0:1787115003.865259:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115003.865374:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602600576 00000100:00100000:1.0:1787115003.865397:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602600576 00000100:00100000:1.0:1787115003.865591:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 126 00000100:00100000:1.0:1787115003.865602:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+15:10533:x1873925602600576:12345-192.168.202.10@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787115003.865684:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c8bd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.865705:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8b8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15e4 expref: 15 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.865715:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c8bd2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.865760:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8b8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15e4 expref: 15 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.865787:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8b8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15e4 expref: 15 pid: 7216 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115003.865805:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eecc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1873925624631680:192.168.202.10@tcp:104: 00000100:00100000:1.0:1787115003.865910:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050747d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787115003.868892:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eecc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1873925624631680:192.168.202.10@tcp:104: 00010000:00010000:1.0:1787115003.868932:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c8bd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115003.872303:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115003.872782:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602600704 00000100:00100000:2.0:1787115003.872795:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602600704 00010000:00010000:2.0:1787115003.872849:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8b8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15e4 expref: 16 pid: 7216 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115003.872925:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 55 00000100:00100000:2.0:1787115003.872936:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+16:2364:x1873925602600704:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115003.872956:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115003.872965:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8b8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15e4 expref: 16 pid: 7216 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.872980:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8b8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15e4 expref: 16 pid: 7216 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.873018:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8b8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15e4 expref: 16 pid: 7216 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.873041:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:2.0:1787115003.873048:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c8bd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.873060:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c8bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.873069:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c8bd2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.873098:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787115003.873364:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c8bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.873374:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c8bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.873530:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c8bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.873538:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c8bd2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.873546:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c8bd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.873552:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0a00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115003.873557:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c8bd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.873579:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c8bd2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.873590:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:0.0:1787115003.873593:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787115003.873598:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c8bd2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.873605:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c8bd2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115003.873687:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+15:10533:x1873925602600576:12345-192.168.202.10@tcp:55:lhsmtool_posix.0 Request processed in 8086us (8441us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787115003.873697:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 126 00000100:00100000:2.0:1787115003.874252:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+14:2364:x1873925602600704:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1316us (1961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115003.874260:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 55 00000100:00100000:2.0:1787115003.876740:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115003.877803:0:11535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602600832 00000100:00100000:0.0:1787115003.877817:0:11535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602600832 00000100:00100000:0.0:1787115003.877890:0:11535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 45 00000100:00100000:0.0:1787115003.877901:0:11535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2364:x1873925602600832:12345-192.168.202.10@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787115003.877959:0:11535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8bd9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.877984:0:11535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c8bb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1600 expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.878004:0:11535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787115003.878010:0:11535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787115003.878016:0:11535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8bd9 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.878076:0:11535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c8bb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1600 expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.878093:0:11535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c8bb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1600 expref: 7 pid: 6578 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115003.878129:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f67ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11535:1873925624631808:192.168.202.10@tcp:104: 00000100:00100000:0.0:1787115003.878479:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af073aeb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787115003.883741:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f67ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11535:1873925624631808:192.168.202.10@tcp:104: 00000100:00100000:0.0:1787115003.883918:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115003.883959:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602600960 00000100:00100000:0.0:1787115003.883968:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602600960 00010000:00010000:0.0:1787115003.884048:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c8bb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1600 expref: 8 pid: 6578 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115003.884094:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 56 00000100:00100000:0.0:1787115003.884104:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2363:x1873925602600960:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787115003.884140:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787115003.884180:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c8bb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1600 expref: 8 pid: 6578 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.884195:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c8bb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1600 expref: 8 pid: 6578 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.884223:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c8bb6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1600 expref: 8 pid: 6578 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.884267:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787115003.884272:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787115003.884280:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8bd9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.884291:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8bd9 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115003.884315:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787115003.884376:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2363:x1873925602600960:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 274us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115003.884462:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 56 00010000:00010000:2.0:1787115003.884600:0:11535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8bd9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.884613:0:11535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8bd9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.884621:0:11535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8bd9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.884652:0:11535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8bd9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.884662:0:11535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8bd9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.884671:0:11535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8bd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.884678:0:11535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030a00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115003.884682:0:11535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8bd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.884693:0:11535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8bd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.884722:0:11535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8bd9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.884730:0:11535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8bd9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115003.884860:0:11535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602600832:12345-192.168.202.10@tcp:1:lhsmtool_posix.0 Request processed in 6960us (8131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115003.884871:0:11535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 45 00000100:00100000:0.0:1787115003.888098:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115003.888239:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602601216 00000100:00100000:1.0:1787115003.888271:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602601216 00000100:00100000:1.0:1787115003.888329:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 127 00000100:00100000:1.0:1787115003.888340:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+14:10533:x1873925602601216:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787115003.888522:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8be0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.888545:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8be0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.888558:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8be0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.888909:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c8be7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.888923:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8b9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15eb expref: 15 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.888933:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c8be7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.888973:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8b9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15eb expref: 15 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.888990:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8b9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15eb expref: 15 pid: 7216 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115003.889020:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eecc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624631936:192.168.202.10@tcp:104: 00000100:00100000:1.0:1787115003.889161:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050747d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787115003.893370:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eecc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624631936:192.168.202.10@tcp:104: 00010000:00010000:1.0:1787115003.893497:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c8be7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115003.896150:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115003.896507:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602601344 00000100:00100000:1.0:1787115003.896520:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602601344 00010000:00010000:1.0:1787115003.896573:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8b9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15eb expref: 16 pid: 7216 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115003.896622:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 57 00000100:00100000:1.0:1787115003.896633:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+16:2363:x1873925602601344:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787115003.896651:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787115003.896659:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8b9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15eb expref: 16 pid: 7216 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.896675:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8b9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15eb expref: 16 pid: 7216 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.896704:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8b9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15eb expref: 16 pid: 7216 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.896729:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:1.0:1787115003.896736:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c8be7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.896747:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c8be7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.896756:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c8be7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.896816:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787115003.896897:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+15:2363:x1873925602601344:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 264us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115003.896906:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 57 00010000:00010000:3.0:1787115003.897089:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c8be7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.897099:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c8be7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787115003.897413:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1787115003.897601:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1787115003.897651:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1787115003.897753:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5787:1873925624632064:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787115003.898694:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115003.898870:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af043cd9540 going to sleep for 11 seconds 00000100:00100000:2.0:1787115003.900362:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624632064 00000100:00100000:2.0:1787115003.900377:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624632064 00000100:00100000:2.0:1787115003.900635:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787115003.900647:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5787:x1873925624632064:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787115003.900817:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5787:x1873925624632064:12345-0@lo:1000:mdt00_002.0 Request processed in 172us (2125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115003.900826:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787115003.900912:0:5787:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787115003.900920:0:5787:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1787115003.900947:0:5787:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8af06f198e00, transno 4294967309 00000004:00080000:3.0:1787115003.900971:0:5787:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8af06f19b100, transno 4294967310 00000100:00100000:3.0:1787115003.900979:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5787:1873925624632064:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1787115003.902152:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1787115003.902351:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5787:1873925624632192:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787115003.902490:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115003.904479:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045be1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787115003.904528:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624632192 00000100:00100000:0.0:1787115003.904540:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624632192 00000100:00100000:1.0:1787115003.904780:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787115003.904792:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5787:x1873925624632192:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787115003.905454:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5787:x1873925624632192:12345-0@lo:1000:mdt00_002.0 Request processed in 593us (2892us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787115003.905467:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787115003.905585:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5787:1873925624632192:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1787115003.905637:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c8be7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.905650:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c8be7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.905664:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c8be7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.905672:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115003.905677:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c8be7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.905701:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c8be7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.905721:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:3.0:1787115003.905724:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787115003.905730:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c8be7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.905737:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0400/0x194cd781e88c8be7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.905785:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8b2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.905793:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8b2a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.905800:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8b2a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.905805:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216fa00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115003.905808:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8b2a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.905814:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8b2a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.905823:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:3.0:1787115003.905826:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787115003.905833:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8b31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15cf expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.905858:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8b31 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15cf expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.905869:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8b31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15cf expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.905913:0:5787:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8b31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15cf expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115003.905931:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624632320:192.168.202.10@tcp:105: 00000100:00100000:3.0:1787115003.906063:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045be1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787115003.910084:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115003.910673:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624632320:192.168.202.10@tcp:105: 00010000:00010000:3.0:1787115003.910714:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8b2a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.910727:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8b2a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.910786:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8bee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.910802:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8bee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.910815:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8bee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.910827:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8bee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.910852:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8bee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.910859:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8bee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.910866:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cbe00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115003.910871:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8bee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.910879:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8bee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.910893:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:3.0:1787115003.910896:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115003.910900:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8bee lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.910907:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8bee lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.910918:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8be0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.910925:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8be0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.910932:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8be0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.910935:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115003.910944:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8be0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.910951:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8be0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.910960:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:3.0:1787115003.910963:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787115003.910966:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8be0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.910973:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8be0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115003.911299:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:10533:x1873925602601216:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 Request processed in 22959us (23213us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1787115003.911311:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 127 00000020:00080000:3.0:1787115003.911318:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787115003.911894:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602601472 00000100:00100000:2.0:1787115003.911905:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602601472 00000100:00100000:2.0:1787115003.911963:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 31 00000100:00100000:2.0:1787115003.911974:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:10532:x1873925602601472:12345-192.168.202.10@tcp:49:lfs.0 00000100:00100000:2.0:1787115003.912134:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:10532:x1873925602601472:12345-192.168.202.10@tcp:49:lfs.0 Request processed in 136us (2040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115003.912142:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 31 00000040:00080000:0.0:1787115003.912713:0:11519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787115003.912719:0:11519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787115003.913480:0:11519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787115003.913491:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787115003.918715:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115003.918814:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115003.918968:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602601728 00000100:00100000:2.0:1787115003.919009:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602601728 00000100:00100000:2.0:1787115003.919081:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 128 00000100:00100000:2.0:1787115003.919092:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:10532:x1873925602601728:12345-192.168.202.10@tcp:58:lfs.0 00000040:00080000:2.0:1787115003.919919:0:7216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787115003.920095:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:10532:x1873925602601728:12345-192.168.202.10@tcp:58:lfs.0 Request processed in 1002us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115003.920131:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 128 00000100:00100000:1.0:1787115003.920638:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602601984 00000100:00100000:1.0:1787115003.920647:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602601984 00000100:00100000:1.0:1787115003.920693:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 32 00000100:00100000:1.0:1787115003.920702:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06634b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:10533:x1873925602601984:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787115003.921844:0:5789:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787115003.921978:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1787115003.922056:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bf5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.922077:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.922091:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.922100:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bf5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.922131:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bf5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.922148:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.922316:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787115003.922438:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06634b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+20:10533:x1873925602601984:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 Request processed in 1734us (3620us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787115003.922448:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 32 00000020:00080000:1.0:1787115003.922454:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787115003.922624:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115003.922633:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bf5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.922642:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0c00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115003.922647:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bf5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.922656:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.922671:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8af0510d6700) 00010000:00010000:2.0:1787115003.922674:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787115003.922680:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bf5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.922686:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8bf5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.922706:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115003.922708:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115003.922710:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787115003.968630:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115003.969041:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602602112 00000100:00100000:3.0:1787115003.969055:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602602112 00000100:00100000:1.0:1787115003.969344:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 129 00000100:00100000:1.0:1787115003.969360:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+20:10535:x1873925602602112:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1787115003.969463:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115003.969494:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c8bfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1607 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.969579:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8c03 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.969596:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8c03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.969610:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8c03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.969628:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8c0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.969637:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.969666:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.970099:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8c11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.970142:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c8b1c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15c8 expref: 21 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.970152:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8c11 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.970829:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c8b1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15c8 expref: 21 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115003.970853:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c8b1c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15c8 expref: 21 pid: 5785 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115003.970871:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eecf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624632448:192.168.202.10@tcp:104: 00000100:00100000:1.0:1787115003.971015:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050747cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787115003.975821:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115003.976629:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eecf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624632448:192.168.202.10@tcp:104: 00010000:00010000:1.0:1787115003.976666:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8c11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115003.976933:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602602368 00000100:00100000:3.0:1787115003.976942:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602602368 00000100:00100000:3.0:1787115003.977053:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 33 00000100:00100000:3.0:1787115003.977066:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+22:5577:x1873925602602368:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787115003.977468:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+23:5577:x1873925602602368:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 403us (1659us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1787115003.977477:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 33 00000100:00100000:0.0:1787115003.980522:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115003.980646:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602602496 00000100:00100000:2.0:1787115003.980658:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602602496 00010000:00010000:2.0:1787115003.980718:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c8b1c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15c8 expref: 23 pid: 5785 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115003.980764:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 58 00000100:00100000:2.0:1787115003.980841:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+23:2363:x1873925602602496:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115003.980861:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115003.980870:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c8b1c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15c8 expref: 23 pid: 5785 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.980884:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c8b1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15c8 expref: 23 pid: 5785 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.980911:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca600/0x194cd781e88c8b1c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15c8 expref: 23 pid: 5785 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.980932:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:2.0:1787115003.980939:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8c11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.980950:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.980959:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8c11 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.981090:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115003.981217:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+22:2363:x1873925602602496:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 379us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115003.981226:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 58 00010000:00010000:3.0:1787115003.982969:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115003.983020:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115003.983303:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787115003.983309:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787115003.983341:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.983359:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.983372:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8c03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.983380:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8c03 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.983460:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8c03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.983467:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1800 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115003.983472:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8c03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.983481:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8c03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.983498:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:2.0:1787115003.983501:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115003.983506:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8c03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.983514:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8c03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.983530:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.983545:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8c0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.983551:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8c0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.983557:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1a00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115003.983560:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8c0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.983568:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8c0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.983576:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8af0510d6900) 00010000:00010000:2.0:1787115003.983579:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115003.983582:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8c0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.983589:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8c0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.983636:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c8bfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1607 expref: 22 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.983653:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8c11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1607 expref: 21 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115003.983662:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:2.0:1787115003.983664:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787115003.983673:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a1e00, rc 0) 00000100:00100000:2.0:1787115003.983862:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+21:10535:x1873925602602112:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 14505us (15246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115003.983871:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 129 00010000:00010000:3.0:1787115004.230727:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787115004.285519:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115004.285577:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115004.285662:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602602624 00000100:00100000:3.0:1787115004.285675:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602602624 00000100:00100000:3.0:1787115004.285734:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 291 00000100:00100000:3.0:1787115004.285743:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602602624:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787115004.285822:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602602624:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 80us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115004.285829:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 291 00000100:00100000:1.0:1787115004.285908:0:11900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602602752 00000100:00100000:1.0:1787115004.285913:0:11900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602602752 00000100:00100000:1.0:1787115004.285963:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 63 00000100:00100000:1.0:1787115004.285971:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2362:x1873925602602752:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787115004.286024:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2362:x1873925602602752:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 54us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115004.286030:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 63 00000100:00080000:3.0:1787115004.286194:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787115004.288407:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115004.288475:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602602880 00000100:00100000:1.0:1787115004.288482:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602602880 00000100:00100000:1.0:1787115004.288549:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 151 00000100:00100000:1.0:1787115004.288560:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067b55fc-03d7-46d6-801a-48936d919d16+5:2361:x1873925602602880:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787115004.288623:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067b55fc-03d7-46d6-801a-48936d919d16+5:2361:x1873925602602880:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 66us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115004.288631:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 151 00000100:00080000:3.0:1787115004.288690:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787115004.805425:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624632576:0@lo:400:kworker.0 00000100:00100000:3.0:1787115004.805498:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115004.805561:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624632576 00000100:00100000:3.0:1787115004.805569:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624632576 00000100:00100000:3.0:1787115004.805604:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787115004.805611:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624632576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115004.805654:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624632576:12345-0@lo:400:kworker.0 Request processed in 43us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115004.805661:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787115004.805701:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624632576:0@lo:400:kworker.0 00000100:00100000:3.0:1787115004.805754:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624632960:0@lo:400:kworker.0 00000100:00100000:3.0:1787115004.805779:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115004.805830:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f8cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624633088:0@lo:400:kworker.0 00000100:00100000:3.0:1787115004.805850:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115004.806046:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624632832:0@lo:400:kworker.0 00000100:00100000:2.0:1787115004.806074:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115004.806099:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787115004.806105:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624632704:0@lo:400:kworker.0 00000100:00100000:2.0:1787115004.806142:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115004.806169:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f8cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624633216:0@lo:400:kworker.0 00000100:00100000:2.0:1787115004.806186:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115004.806280:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624632960 00000100:00100000:2.0:1787115004.806285:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624632960 00000100:00100000:2.0:1787115004.806320:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624633216 00000100:00100000:2.0:1787115004.806323:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624633216 00000100:00100000:2.0:1787115004.806341:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787115004.806348:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1873925624632960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115004.806384:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1873925624632960:12345-0@lo:400:kworker.0 Request processed in 37us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115004.806390:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787115004.806403:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787115004.806409:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f19a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1873925624633216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115004.806438:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f19a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1873925624633216:12345-0@lo:400:kworker.0 Request processed in 29us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115004.806443:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787115004.806461:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624633088 00000100:00100000:2.0:1787115004.806464:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624633088 00000100:00100000:2.0:1787115004.806496:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624632832 00000100:00100000:2.0:1787115004.806499:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624632832 00000100:00100000:2.0:1787115004.806509:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624632704 00000100:00100000:2.0:1787115004.806511:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624632704 00000100:00100000:2.0:1787115004.806521:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787115004.806526:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624633088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115004.806560:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624633088:12345-0@lo:400:kworker.0 Request processed in 34us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115004.806566:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787115004.806576:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787115004.806582:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624632832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115004.806605:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624632832:12345-0@lo:400:kworker.0 Request processed in 24us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115004.806611:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787115004.806620:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787115004.806626:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624632704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115004.806650:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624632704:12345-0@lo:400:kworker.0 Request processed in 24us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115004.806656:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1787115004.806678:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787115004.806682:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787115004.806712:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624632960:0@lo:400:kworker.0 00000100:00100000:2.0:1787115004.806737:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624632704:0@lo:400:kworker.0 00000100:00100000:2.0:1787115004.806746:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f8cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624633216:0@lo:400:kworker.0 00000100:00100000:2.0:1787115004.806754:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624632832:0@lo:400:kworker.0 00000100:00100000:2.0:1787115004.806791:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f8cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624633088:0@lo:400:kworker.0 00000100:00100000:1.0:1787115004.808809:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787115004.808828:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624633344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787115004.808884:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115004.810365:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624633344 00000100:00100000:2.0:1787115004.810378:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624633344 00000100:00100000:2.0:1787115004.811138:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787115004.811151:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1873925624633344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787115004.811198:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787115004.811281:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1873925624633344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (2396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115004.811288:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787115004.811562:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624633344:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787115004.949474:0:11519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787115004.949484:0:11519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787115004.949541:0:11519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787115004.949548:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787115004.949667:0:11519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f198000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11519:1873925624633472:192.168.202.10@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787115004.949768:0:11519:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5fab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787115004.955002:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115004.955195:0:11519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f198000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11519:1873925624633472:192.168.202.10@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787115004.955443:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602603008 00000100:00100000:1.0:1787115004.955451:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602603008 00000100:00100000:1.0:1787115004.955507:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 130 00000100:00100000:1.0:1787115004.955517:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+21:10546:x1873925602603008:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787115004.955570:0:5785:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787115004.955674:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+21:10546:x1873925602603008:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 Request processed in 158us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115004.955682:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 130 00000100:00100000:1.0:1787115004.966661:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115004.966708:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602603264 00000100:00100000:1.0:1787115004.966719:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602603264 00000100:00100000:1.0:1787115004.966792:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 131 00000100:00100000:1.0:1787115004.966805:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+21:10546:x1873925602603264:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787115004.966838:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115004.966881:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c8c18 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d160e expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115004.967621:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8c1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115004.967642:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8c1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115004.967655:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8c1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787115004.967668:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787115004.967818:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c8c18 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d160e expref: 24 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115004.967836:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8c1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d160e expref: 23 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115004.968414:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:1.0:1787115004.968417:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787115004.968420:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0800, rc 0) 00000100:00100000:1.0:1787115004.968479:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+23:10546:x1873925602603264:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 1678us (1833us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787115004.968485:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 131 00000100:00100000:1.0:1787115004.976033:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115004.976141:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115004.976961:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602603392 00000100:00100000:1.0:1787115004.976978:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602603392 00000100:00100000:1.0:1787115004.977055:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00100000:1.0:1787115004.977065:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+23:2362:x1873925602603392:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787115004.977080:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787115004.977125:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8c1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d160e expref: 23 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115004.977142:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:1.0:1787115004.977147:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787115004.977268:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+22:2362:x1873925602603392:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 204us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115004.977276:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00100000:1.0:1787115004.977384:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602603648 00000100:00100000:1.0:1787115004.977389:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602603648 00000100:00100000:1.0:1787115004.977415:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 132 00000100:00100000:1.0:1787115004.977421:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+22:10546:x1873925602603648:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787115004.977483:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8c2d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115004.977497:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8c2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115004.977507:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8c2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115004.977693:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8c2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115004.977701:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8c2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115004.977714:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8c2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115004.977720:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115004.977724:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8c2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115004.977731:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8c2d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115004.977740:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:1.0:1787115004.977743:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787115004.977746:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8c2d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115004.977752:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8c2d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115004.977867:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+23:10546:x1873925602603648:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 Request processed in 444us (1725us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787115004.977874:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 132 00000040:00080000:2.0:1787115004.978554:0:11519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787115004.978560:0:11519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1787115004.981518:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115004.981768:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602603904 00000100:00100000:3.0:1787115004.981778:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602603904 00000100:00100000:3.0:1787115004.981826:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 34 00000100:00100000:3.0:1787115004.981836:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+23:10546:x1873925602603904:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787115004.982092:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+24:10546:x1873925602603904:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 Request processed in 256us (579us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787115004.982100:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 34 00000040:00080000:2.0:1787115004.982713:0:11519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787115004.982726:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787115005.111932:0:11938:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787115005.111942:0:11938:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787115005.118218:0:11938:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787115005.118236:0:11938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787115005.253676:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787115005.289802:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115005.294670:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602604160 00000100:00100000:0.0:1787115005.294689:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602604160 00000100:00100000:0.0:1787115005.294819:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 133 00000100:00100000:0.0:1787115005.294832:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+24:10559:x1873925602604160:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1787115005.294863:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115005.294891:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8c34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1615 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115005.295038:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8c3b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115005.295065:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8c3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115005.295080:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8c3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115005.295093:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787115005.295294:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8c34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1615 expref: 27 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115005.295316:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8c3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1615 expref: 26 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115005.295326:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:0.0:1787115005.295329:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787115005.295347:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040031000, rc 0) 00000100:00100000:0.0:1787115005.295441:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+26:10559:x1873925602604160:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 612us (5654us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1787115005.295450:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 133 00000100:00100000:0.0:1787115005.300880:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115005.300964:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602604288 00000100:00100000:3.0:1787115005.300977:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602604288 00000100:00100000:3.0:1787115005.301067:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 134 00000100:00100000:3.0:1787115005.301078:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+26:10559:x1873925602604288:12345-192.168.202.10@tcp:54:lfs.0 00010000:00010000:3.0:1787115005.301480:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115005.301504:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115005.301521:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115005.301569:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115005.301577:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115005.301598:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115005.301606:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cbe00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115005.301611:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115005.301621:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115005.301636:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:3.0:1787115005.301640:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787115005.301645:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115005.301652:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115005.301745:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+26:10559:x1873925602604288:12345-192.168.202.10@tcp:54:lfs.0 Request processed in 668us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115005.301754:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 134 00000100:00080000:2.0:1787115005.304418:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787115005.317755:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787115005.317784:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624633600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787115005.317870:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115005.317993:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624633600 00000100:00100000:0.0:1787115005.318004:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624633600 00000100:00100000:0.0:1787115005.318506:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787115005.318518:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1873925624633600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787115005.319000:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787115005.319796:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1873925624633600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1276us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115005.319810:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1787115005.323249:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787115005.335477:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624633600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787115005.402685:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115005.411370:0:11900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602604416 00000100:00100000:3.0:1787115005.411393:0:11900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602604416 00000100:00100000:3.0:1787115005.411838:0:11900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 46 00000100:00100000:3.0:1787115005.411854:0:11900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f19b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2362:x1873925602604416:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1787115005.411880:0:11900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115005.411916:0:11900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052fff536/0x194cd781e88c8c50 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d161c expref: -99 pid: 11900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787115005.411950:0:11900:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8535fb, atime: 0x6a8535fb, ctime: 0x6a8535fb, blocks: 0xb 00010000:00010000:3.0:1787115005.411976:0:11900:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=334s v=(0 0) 00010000:00010000:3.0:1787115005.411999:0:11900:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115005.412014:0:11900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052fff536/0x194cd781e88c8c50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d161c expref: 7 pid: 11900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115005.416269:0:11900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000052fff536/0x194cd781e88c8c50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d161c expref: 7 pid: 11900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115005.416321:0:11900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429ca600, rc 0) 00000100:00100000:3.0:1787115005.418737:0:11900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f19b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2362:x1873925602604416:12345-192.168.202.10@tcp:101:cat.0 Request processed in 6871us (16051us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115005.418753:0:11900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 46 00000100:00100000:0.0:1787115005.426426:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1787115005.426477:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787115005.427699:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602604544 00000100:00100000:1.0:1787115005.427731:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602604544 00002000:00100000:1.0:1787115005.427793:0:6583:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8af07f962300 x1873925602604544/t0(0) o3->6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp:571/0 lens 488/0 e 0 to 0 dl 1787115016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787115005.427806:0:6583:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af07f962300 with x1873925602604544 ext(0->4095) 00002000:00010000:1.0:1787115005.427813:0:6583:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af07f962300 00000100:00100000:1.0:1787115005.427843:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 3 00000100:00100000:1.0:1787115005.427853:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2361:x1873925602604544:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:1.0:1787115005.428164:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2361:x1873925602604544:12345-192.168.202.10@tcp:3:cat.0 Request processed in 311us (1749us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787115005.428172:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 3 00002000:00100000:1.0:1787115005.428179:0:6583:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8af07f962300 x1873925602604544/t0(0) o3->6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp:571/0 lens 488/4536 e 0 to 0 dl 1787115016 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787115005.428188:0:6583:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af07f962300 with x1873925602604544 ext(0->4095) 00002000:00010000:1.0:1787115005.428192:0:6583:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af07f962300 00000001:00080000:3.0:1787115005.493744:0:6604:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:3.0:1787115005.493786:0:6604:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1787115005.493792:0:6604:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000040:00080000:2.0:1787115006.024003:0:11519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787115006.024026:0:11519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787115006.024064:0:11519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787115006.024070:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787115006.278081:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115007.301495:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115008.325379:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787115008.950412:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1787115008.950435:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1787115008.957628:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1787115008.957646:0:5807:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1787115008.957692:0:5807:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8af043cd9480 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787115008.957698:0:5807:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af048a38a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8af043cd9540 00000020:00080000:1.0:1787115008.957702:0:5807:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af048a38b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af07f7f3000 00000020:00080000:1.0:1787115008.957881:0:5818:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787115008.958058:0:5818:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1787115009.349356:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787115009.423063:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115009.423149:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115009.423189:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115009.423225:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115009.423248:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115009.423515:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602605056 00000100:00100000:2.0:1787115009.423527:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602605056 00000100:00100000:0.0:1787115009.423579:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602604800 00000100:00100000:0.0:1787115009.423585:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602604800 00000100:00100000:2.0:1787115009.423601:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602604928 00000100:00100000:2.0:1787115009.423606:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602604928 00000100:00100000:0.0:1787115009.423623:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602605184 00000100:00100000:0.0:1787115009.423629:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602605184 00000100:00100000:2.0:1787115009.423639:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 66 00000100:00100000:2.0:1787115009.423652:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602605056:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787115009.423662:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 155 00000100:00100000:0.0:1787115009.423673:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+13:2364:x1873925602604800:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787115009.423730:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602605056:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 81us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115009.423737:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 66 00000100:00100000:2.0:1787115009.423754:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 67 00000100:00100000:2.0:1787115009.423761:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2364:x1873925602604928:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787115009.423789:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+13:2364:x1873925602604800:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 118us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115009.423793:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2364:x1873925602604928:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 30us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115009.423804:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 155 00000100:00100000:2.0:1787115009.423807:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 67 00000100:00100000:0.0:1787115009.423829:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 156 00000100:00100000:0.0:1787115009.423839:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+5:2364:x1873925602605184:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787115009.423865:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+5:2364:x1873925602605184:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 28us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115009.423881:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 156 00000100:00100000:3.0:1787115009.427526:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602604672 00000100:00100000:3.0:1787115009.427545:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602604672 00000100:00100000:3.0:1787115009.427632:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 293 00000100:00100000:3.0:1787115009.427643:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2364:x1873925602604672:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787115009.427723:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2364:x1873925602604672:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 83us (4533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115009.427746:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 293 00000100:00080000:1.0:1787115009.427850:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787115009.427867:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787115009.427870:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787115009.925685:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787115009.925709:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f8cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624633728:0@lo:400:kworker.0 00000100:00100000:3.0:1787115009.925776:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115009.925834:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624633728 00000100:00100000:3.0:1787115009.925842:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624633728 00000100:00100000:3.0:1787115009.925896:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787115009.925904:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624633728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115009.925962:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624633728:12345-0@lo:400:kworker.0 Request processed in 59us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115009.925971:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787115009.926023:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f8cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624633728:0@lo:400:kworker.0 00000100:00100000:3.0:1787115009.926063:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f8cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624633856:0@lo:400:kworker.0 00000100:00100000:3.0:1787115009.926089:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115009.926156:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f8cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624633984:0@lo:400:kworker.0 00000100:00100000:3.0:1787115009.926192:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115009.926221:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624633856 00000100:00100000:3.0:1787115009.926224:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624633856 00000100:00100000:3.0:1787115009.926246:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624633984 00000100:00100000:3.0:1787115009.926249:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624633984 00000100:00100000:3.0:1787115009.926273:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787115009.926280:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624633856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115009.926310:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624633856:12345-0@lo:400:kworker.0 Request processed in 32us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115009.926316:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787115009.926345:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787115009.926351:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624633984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115009.926382:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624633984:12345-0@lo:400:kworker.0 Request processed in 31us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115009.926387:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787115009.926433:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f8cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624633856:0@lo:400:kworker.0 00000100:00100000:3.0:1787115009.926454:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f8cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624633984:0@lo:400:kworker.0 00000100:00100000:3.0:1787115009.926479:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f8cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624634112:0@lo:400:kworker.0 00000100:00100000:3.0:1787115009.926503:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115009.926530:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624634112 00000100:00100000:3.0:1787115009.926533:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624634112 00000100:00100000:3.0:1787115009.926557:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787115009.926563:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624634112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115009.926608:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624634112:12345-0@lo:400:kworker.0 Request processed in 46us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115009.926615:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787115009.926634:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787115009.926642:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1787115009.926658:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8af0739eea00, transno 4294967304 00000100:00100000:3.0:1787115009.926668:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f8cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624634112:0@lo:400:kworker.0 00000100:00100000:3.0:1787115009.927029:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787115009.927038:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f8cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624634240:0@lo:400:kworker.0 00000100:00100000:3.0:1787115009.927078:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115009.927104:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624634240 00000100:00100000:3.0:1787115009.927129:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624634240 00000100:00100000:3.0:1787115009.927161:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787115009.927167:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624634240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115009.927202:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624634240:12345-0@lo:400:kworker.0 Request processed in 35us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115009.927208:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1787115009.927778:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787115009.927784:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787115009.929324:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f19b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624634496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787115009.929386:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115009.930658:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787115009.930671:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eeced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624634368:0@lo:400:kworker.0 00000100:00100000:3.0:1787115009.930711:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115009.930779:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f8cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624634240:0@lo:400:kworker.0 00000100:00100000:0.0:1787115009.932007:0:11535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624634368 00000100:00100000:0.0:1787115009.932020:0:11535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624634368 00000100:00100000:0.0:1787115009.932095:0:11535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787115009.932127:0:11535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624634368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787115009.932205:0:11535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624634368:12345-0@lo:400:kworker.0 Request processed in 100us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115009.932212:0:11535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1787115009.932273:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787115009.932978:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1787115009.932987:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1787115009.933012:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eeced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624634368:0@lo:400:kworker.0 00000100:00100000:2.0:1787115009.934839:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624634496 00000100:00100000:2.0:1787115009.934861:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624634496 00000100:00100000:2.0:1787115009.934923:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787115009.934933:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624634496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787115009.934984:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787115009.935063:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624634496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (5676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115009.935070:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787115009.935141:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f19b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624634496:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787115010.374543:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787115010.440576:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624634624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787115010.440643:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115010.443230:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624634624 00000100:00100000:2.0:1787115010.443247:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624634624 00000100:00100000:2.0:1787115010.443313:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787115010.443324:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624634624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787115010.443362:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787115010.443443:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624634624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (2799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115010.443451:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787115010.444440:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624634624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787115011.098448:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115011.098534:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602605312 00000100:00100000:3.0:1787115011.098544:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602605312 00000100:00100000:3.0:1787115011.098612:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 135 00000100:00100000:3.0:1787115011.098622:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+13:10212:x1873925602605312:12345-192.168.202.10@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787115011.098753:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+13:10212:x1873925602605312:12345-192.168.202.10@tcp:60:lhsmtool_posix.0 Request processed in 133us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115011.098761:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 135 00000100:00080000:1.0:1787115011.099285:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787115011.108010:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115011.108101:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602605568 00000100:00100000:3.0:1787115011.108151:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602605568 00000100:00100000:3.0:1787115011.108214:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 35 00000100:00100000:3.0:1787115011.108225:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f19b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+13:10212:x1873925602605568:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787115011.108728:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f19b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+14:10212:x1873925602605568:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 Request processed in 503us (726us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787115011.108737:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 35 00010000:00010000:2.0:1787115011.397507:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787115011.616060:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115011.616516:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602605696 00000100:00100000:3.0:1787115011.616527:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602605696 00000100:00100000:3.0:1787115011.616611:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 136 00000100:00100000:3.0:1787115011.616622:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+5:11012:x1873925602605696:12345-192.168.202.10@tcp:101:lsof.0 00010000:00010000:3.0:1787115011.616643:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115011.616664:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8c57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1623 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115011.616741:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115011.616755:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115011.616768:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787115011.616980:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787115011.616985:0:7216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787115011.617083:0:7216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115011.617163:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8c57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1623 expref: 7 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115011.617181:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1623 expref: 6 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115011.617197:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0514c6c00) 00010000:00010000:3.0:1787115011.617201:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787115011.617205:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429cbe00, rc 0) 00000100:00100000:3.0:1787115011.617263:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+6:11012:x1873925602605696:12345-192.168.202.10@tcp:101:lsof.0 Request processed in 643us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115011.617270:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 136 00000100:00080000:1.0:1787115011.621030:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787115012.421381:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115013.448660:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787115014.096822:0:5807:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1787115014.096859:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1787115014.096928:0:5818:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787115014.096942:0:5818:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1787115014.469320:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787115014.530205:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115014.530243:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115014.530280:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115014.530302:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115014.530326:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115014.530370:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602606336 00000100:00100000:3.0:1787115014.530381:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602606336 00000100:00100000:3.0:1787115014.530441:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602605952 00000100:00100000:3.0:1787115014.530444:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602605952 00000100:00100000:3.0:1787115014.530475:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 160 00000100:00100000:3.0:1787115014.530485:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067b55fc-03d7-46d6-801a-48936d919d16+6:2364:x1873925602606336:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787115014.530562:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067b55fc-03d7-46d6-801a-48936d919d16+6:2364:x1873925602606336:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 78us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115014.530570:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 160 00000100:00100000:3.0:1787115014.530590:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 161 00000100:00100000:3.0:1787115014.530597:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+13:2364:x1873925602605952:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787115014.530627:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+13:2364:x1873925602605952:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 31us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115014.530648:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 161 00000100:00100000:3.0:1787115014.530672:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602606080 00000100:00100000:3.0:1787115014.530675:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602606080 00000100:00100000:3.0:1787115014.530700:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602606208 00000100:00100000:3.0:1787115014.530703:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602606208 00000100:00100000:3.0:1787115014.530726:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 70 00000100:00100000:3.0:1787115014.530732:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2364:x1873925602606080:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787115014.530763:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2364:x1873925602606080:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 32us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115014.530770:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 70 00000100:00100000:3.0:1787115014.530781:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 71 00000100:00100000:3.0:1787115014.530787:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602606208:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787115014.530807:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602606208:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 21us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115014.530813:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 71 00000100:00100000:0.0:1787115014.531169:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602605824 00000100:00100000:0.0:1787115014.531175:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602605824 00000100:00100000:0.0:1787115014.531206:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 295 00000100:00100000:0.0:1787115014.531212:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2364:x1873925602605824:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787115014.531243:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2364:x1873925602605824:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 32us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115014.531249:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 295 00000100:00080000:1.0:1787115014.534282:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787115014.534292:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787115014.534295:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787115015.045600:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624635136:0@lo:400:kworker.0 00000100:00100000:1.0:1787115015.045676:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115015.045737:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787115015.045743:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624634752:0@lo:400:kworker.0 00000100:00100000:1.0:1787115015.045771:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115015.045792:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624635264:0@lo:400:kworker.0 00000100:00100000:1.0:1787115015.045816:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115015.045875:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624634880:0@lo:400:kworker.0 00000100:00100000:2.0:1787115015.045915:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115015.045942:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624635392:0@lo:400:kworker.0 00000100:00100000:2.0:1787115015.045963:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115015.045981:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787115015.045986:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624635008:0@lo:400:kworker.0 00000100:00100000:2.0:1787115015.046007:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115015.046038:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624635136 00000100:00100000:2.0:1787115015.046045:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624635136 00000100:00100000:2.0:1787115015.046145:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624635392 00000100:00100000:2.0:1787115015.046149:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624635392 00000100:00100000:2.0:1787115015.046178:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787115015.046192:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eeced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624635136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115015.046248:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eeced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624635136:12345-0@lo:400:kworker.0 Request processed in 63us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115015.046255:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787115015.046282:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787115015.046289:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f19aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624635392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115015.046320:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f19aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624635392:12345-0@lo:400:kworker.0 Request processed in 33us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115015.046326:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787115015.046344:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624635264 00000100:00100000:2.0:1787115015.046348:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624635264 00000100:00100000:2.0:1787115015.046371:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624634880 00000100:00100000:2.0:1787115015.046374:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624634880 00000100:00100000:2.0:1787115015.046384:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624635008 00000100:00100000:2.0:1787115015.046386:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624635008 00000100:00100000:2.0:1787115015.046397:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787115015.046402:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624635264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115015.046430:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624635264:12345-0@lo:400:kworker.0 Request processed in 28us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115015.046436:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787115015.046448:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787115015.046453:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624634880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115015.046475:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624634880:12345-0@lo:400:kworker.0 Request processed in 23us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115015.046480:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787115015.046489:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787115015.046494:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624635008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115015.046515:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624635008:12345-0@lo:400:kworker.0 Request processed in 22us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115015.046520:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:2.0:1787115015.046537:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787115015.046547:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787115015.046549:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787115015.046601:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0591d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624635520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787115015.046629:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115015.046658:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624635520 00000100:00100000:2.0:1787115015.046661:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624635520 00000100:00100000:2.0:1787115015.046686:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787115015.046692:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624635520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787115015.046721:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787115015.046755:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624635520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115015.046761:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787115015.046804:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0591d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624635520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787115015.046835:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624635008:0@lo:400:kworker.0 00000100:00100000:2.0:1787115015.046845:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624634880:0@lo:400:kworker.0 00000100:00100000:2.0:1787115015.046854:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624635392:0@lo:400:kworker.0 00000100:00100000:2.0:1787115015.047003:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624635264:0@lo:400:kworker.0 00000100:00100000:2.0:1787115015.047014:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624635136:0@lo:400:kworker.0 00000100:00100000:3.0:1787115015.047326:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624634752 00000100:00100000:3.0:1787115015.047332:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624634752 00000100:00100000:3.0:1787115015.047372:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1787115015.047380:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624634752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115015.047425:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624634752:12345-0@lo:400:kworker.0 Request processed in 47us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115015.047431:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787115015.047991:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624634752:0@lo:400:kworker.0 00000001:02000400:3.0:1787115015.273901:0:12141:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 00:50:14 (1787115014) 00010000:00010000:3.0:1787115015.494233:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787115015.557430:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624635648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787115015.557505:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115015.557609:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624635648 00000100:00100000:0.0:1787115015.557618:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624635648 00000100:00100000:0.0:1787115015.557675:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787115015.557684:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624635648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787115015.557733:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787115015.557778:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624635648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115015.557784:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787115015.557968:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624635648:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787115016.262202:0:11519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787115016.262213:0:11519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787115016.262757:0:11519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787115016.262766:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787115016.517295:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787115016.722401:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115016.722618:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602606592 00000100:00100000:2.0:1787115016.722644:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602606592 00000100:00100000:2.0:1787115016.722738:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 137 00000100:00100000:2.0:1787115016.722749:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+13:11278:x1873925602606592:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787115016.722770:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115016.722791:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8c65 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d162a expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.722865:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8c6c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.722890:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8c6c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.722903:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8c6c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.722920:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8c73 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.722927:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8c73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.722934:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8c73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787115016.722948:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787115016.723432:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8c7a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.723443:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8c7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.723450:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8c7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115016.723468:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787115016.723661:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8c6c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.723670:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8c6c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.723677:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8c6c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.723683:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115016.723688:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8c6c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.723697:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8c6c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.723710:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8af0514c6700) 00010000:00010000:2.0:1787115016.723713:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115016.723718:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8c6c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.723725:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8c6c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.723740:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8c73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.723747:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8c73 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.723762:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8c73 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.723768:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216f800 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115016.723771:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8c73 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.723777:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8c73 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.723785:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8af0514c6300) 00010000:00010000:2.0:1787115016.723787:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115016.723790:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8c73 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.723796:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8c73 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.724264:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8c65 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d162a expref: 16 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.724281:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8c7a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d162a expref: 15 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.724289:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8af0510d6d00) 00010000:00010000:2.0:1787115016.724291:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115016.724293:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216f200, rc 0) 00000100:00100000:2.0:1787115016.724371:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+15:11278:x1873925602606592:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 1624us (1979us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787115016.724390:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 137 00000100:00100000:0.0:1787115016.730053:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115016.730173:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602606720 00000100:00100000:3.0:1787115016.730184:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602606720 00000100:00100000:3.0:1787115016.730247:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 138 00000100:00100000:3.0:1787115016.730256:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+15:11278:x1873925602606720:12345-192.168.202.10@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787115016.730369:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+15:11278:x1873925602606720:12345-192.168.202.10@tcp:59:lhsmtool_posix.0 Request processed in 113us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115016.730377:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 138 00000100:00100000:3.0:1787115016.730912:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115016.733743:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602606848 00000100:00100000:2.0:1787115016.733765:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602606848 00000100:00100000:2.0:1787115016.733872:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 10 00000100:00100000:2.0:1787115016.733894:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+15:2362:x1873925602606848:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115016.733915:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115016.733945:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8c7a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d162a expref: 15 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115016.733965:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8af0510d6d00) 00010000:00010000:2.0:1787115016.733970:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115016.734039:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+14:2362:x1873925602606848:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 147us (3128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115016.734047:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 10 00000040:00080000:0.0:1787115017.291415:0:11519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787115017.291426:0:11519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787115017.291980:0:11519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787115017.291991:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787115017.543152:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115018.567950:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787115018.797315:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115018.797620:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602606976 00000100:00100000:0.0:1787115018.797640:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602606976 00000100:00100000:0.0:1787115018.797711:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 139 00000100:00100000:0.0:1787115018.797722:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+14:11321:x1873925602606976:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1787115018.797746:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115018.797772:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8c88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1631 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.797843:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8c8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.797874:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8c8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.797887:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8c8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.797929:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8c96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.797938:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8c96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.797945:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8c96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787115018.798844:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787115018.798990:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8c8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.799002:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8c8f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.799010:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8c8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.799422:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040031600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115018.799429:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8c8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.799439:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8c8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.799454:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0514c6c00) 00010000:00010000:0.0:1787115018.799458:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115018.799462:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8c8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.799468:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8c8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.799489:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8c96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.799496:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8c96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.799502:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8c96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.799507:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115018.799510:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8c96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.799516:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8c96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.799524:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8af051ecb500) 00010000:00010000:0.0:1787115018.799526:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115018.799529:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8c96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.799534:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8c96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.799572:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8c88 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1631 expref: 15 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.799584:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0514c6c00) 00010000:00010000:0.0:1787115018.799586:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115018.799596:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8c88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1631 expref: 15 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.799883:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030c00, rc 0) 00000100:00100000:0.0:1787115018.800370:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+14:11321:x1873925602606976:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 2647us (3063us total) trans 0 rc 301/301 00000100:00100000:0.0:1787115018.800380:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 139 00000100:00100000:2.0:1787115018.817668:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115018.818003:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602607232 00000100:00100000:0.0:1787115018.818014:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602607232 00000100:00100000:0.0:1787115018.818085:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 140 00000100:00100000:0.0:1787115018.818096:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+14:11321:x1873925602607232:12345-192.168.202.10@tcp:36:lfs.0 00010000:00010000:0.0:1787115018.818192:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787115018.818229:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c8606 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d146a expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.818543:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0514c6c00) 00010000:00010000:0.0:1787115018.818548:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787115018.818899:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8c9d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.818916:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1623 expref: 5 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.818925:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8c9d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.818961:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1623 expref: 5 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115018.819415:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1623 expref: 5 pid: 7216 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115018.819433:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb72680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1873925624635776:192.168.202.10@tcp:104: 00000100:00100000:0.0:1787115018.819542:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5facc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787115018.826902:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115018.826948:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602607360 00000100:00100000:1.0:1787115018.826967:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602607360 00010000:00010000:1.0:1787115018.827037:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c5e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1623 expref: 6 pid: 7216 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115018.827079:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 59 00000100:00100000:1.0:1787115018.827089:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067b55fc-03d7-46d6-801a-48936d919d16+6:2363:x1873925602607360:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787115018.827128:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787115018.827137:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c5e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1623 expref: 6 pid: 7216 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115018.827150:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1623 expref: 6 pid: 7216 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115018.827567:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0514c6c00) 00010000:00010000:1.0:1787115018.827574:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8c9d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115018.827584:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8c9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115018.827591:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8c9d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115018.827610:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787115018.827662:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067b55fc-03d7-46d6-801a-48936d919d16+6:2363:x1873925602607360:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 574us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115018.827670:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 59 00000100:00080000:1.0:1787115018.827694:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787115018.828517:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8c5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1623 expref: 5 pid: 7216 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115018.828540:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb72680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1873925624635776:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787115018.828562:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8c9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115018.828572:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8c9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115018.828578:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8c9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115018.828602:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ca4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115018.828623:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115018.828632:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787115018.831874:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787115018.831900:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8c9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115018.831913:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8c9d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115018.831923:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8c9d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115018.831931:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115018.831936:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8c9d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115018.831945:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8c9d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115018.831966:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0514c6c00) 00010000:00010000:3.0:1787115018.831969:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115018.831974:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8c9d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115018.831980:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8c9d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787115018.832780:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004fb4157e reply state 0000000086994fbe transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115018.832796:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787115018.832979:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+15:11321:x1873925602607232:12345-192.168.202.10@tcp:36:lfs.0 Request processed in 14880us (15316us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1787115018.832998:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 140 00010000:00010000:2.0:1787115018.847798:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115018.847814:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ca4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115018.847821:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ca4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115018.847828:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cae00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115018.847833:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ca4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115018.847866:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ca4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115018.847884:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8af044d99100) 00010000:00010000:2.0:1787115018.847887:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115018.847892:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ca4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115018.847898:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ca4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115018.921584:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115018.921634:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602607488 00000100:00100000:3.0:1787115018.921647:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602607488 00000100:00100000:3.0:1787115018.921709:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 141 00000100:00100000:3.0:1787115018.921719:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+14:11329:x1873925602607488:12345-192.168.202.10@tcp:101:lctl.0 00010000:00010000:3.0:1787115018.921747:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115018.921774:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8cab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1638 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115018.921844:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8cb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115018.921870:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115018.921882:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787115018.921950:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787115018.921954:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787115018.921986:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115018.922026:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8cab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1638 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115018.922045:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1638 expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115018.922054:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af044d99800) 00010000:00010000:3.0:1787115018.922058:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787115018.922061:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af0429ca000, rc 0) 00000100:00100000:3.0:1787115018.922139:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+15:11329:x1873925602607488:12345-192.168.202.10@tcp:101:lctl.0 Request processed in 421us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115018.922146:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 141 00000100:00100000:1.0:1787115019.000349:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115019.000431:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602607616 00000100:00100000:2.0:1787115019.000443:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602607616 00000100:00100000:2.0:1787115019.000507:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 142 00000100:00100000:2.0:1787115019.000520:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+15:11335:x1873925602607616:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:2.0:1787115019.000542:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115019.000573:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8cb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d163f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.000700:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8cc0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.000715:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.001097:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.001135:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8cc7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.001151:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.001220:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.001332:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8cce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.001341:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8cce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.001349:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8cce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115019.001378:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787115019.001382:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787115019.001408:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8cce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.001420:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.001428:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8cc0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.001435:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8cc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.001441:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115019.001445:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8cc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.001459:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8cc0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.001471:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af044d99800) 00010000:00010000:2.0:1787115019.001474:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115019.001478:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8cc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.001483:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8cc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.001498:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.001505:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8cc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.001512:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.001517:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216f800 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115019.001520:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.001527:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.001534:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8af0514c6300) 00010000:00010000:2.0:1787115019.001537:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115019.001539:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8cc7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.001555:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8cc7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.002830:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8cb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d163f expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.002869:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8cce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d163f expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.002880:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:2.0:1787115019.002883:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787115019.002886:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216fa00, rc 0) 00000100:00100000:2.0:1787115019.002984:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+16:11335:x1873925602607616:12345-192.168.202.10@tcp:101:bash.0 Request processed in 2467us (2644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115019.002994:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 142 00000100:00100000:2.0:1787115019.013850:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115019.013941:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602607872 00000100:00100000:3.0:1787115019.013952:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602607872 00000100:00100000:3.0:1787115019.014032:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 143 00000100:00100000:3.0:1787115019.014042:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0591d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+16:11335:x1873925602607872:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:3.0:1787115019.014064:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115019.014088:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8cd5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1646 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.014302:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8cdc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.014317:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8cdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.014330:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8cdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.014411:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ce3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.014420:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ce3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.014427:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ce3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787115019.014970:0:5786:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1787115019.015167:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8cea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.015177:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8cea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.015184:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8cea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.015216:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8cdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.015222:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8cdc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.015229:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8cdc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.015234:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cba00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115019.015239:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8cdc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.015257:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8cdc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.015268:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:3.0:1787115019.015271:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115019.015276:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8cdc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.015281:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cba00/0x194cd781e88c8cdc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787115019.015293:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000acf7751f reply state 00000000e04a9fb7 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ce3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115019.015303:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787115019.015335:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cbe00/0x194cd781e88c8cd5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1646 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.015349:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8cea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1646 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.015356:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af044d99200) 00010000:00010000:3.0:1787115019.015358:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787115019.015360:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041682200, rc 0) 00000100:00100000:3.0:1787115019.015436:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0591d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+19:11335:x1873925602607872:12345-192.168.202.10@tcp:101:bash.0 Request processed in 1395us (1597us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1787115019.015445:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 143 00010000:00010000:0.0:1787115019.018016:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ce3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.018035:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ce3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.018043:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ce3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.018050:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cae00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115019.018055:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ce3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.018063:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ce3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.018083:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8af044d99000) 00010000:00010000:0.0:1787115019.018087:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115019.018101:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ce3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.018148:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429cae00/0x194cd781e88c8ce3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115019.020201:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115019.020360:0:11900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602608000 00000100:00100000:3.0:1787115019.020378:0:11900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602608000 00000100:00100000:3.0:1787115019.020688:0:11900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 47 00000100:00100000:3.0:1787115019.020700:0:11900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2361:x1873925602608000:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:3.0:1787115019.020719:0:11900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115019.020806:0:11900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a910b37/0x194cd781e88c8cf8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d164d expref: -99 pid: 11900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787115019.020835:0:11900:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115019.020886:0:11900:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=348s v=(0 0) 00010000:00010000:3.0:1787115019.020892:0:11900:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115019.020902:0:11900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a910b37/0x194cd781e88c8cf8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d164d expref: 6 pid: 11900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.020921:0:11900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a910b37/0x194cd781e88c8cf8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d164d expref: 6 pid: 11900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.020935:0:11900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041683000, rc 0) 00000100:00100000:3.0:1787115019.020995:0:11900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2361:x1873925602608000:12345-192.168.202.10@tcp:101:bash.0 Request processed in 297us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115019.021002:0:11900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 47 00000100:00080000:1.0:1787115019.021424:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787115019.029057:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115019.029357:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602608128 00000100:00100000:3.0:1787115019.029367:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602608128 00000100:00100000:3.0:1787115019.029431:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 48 00000100:00100000:3.0:1787115019.029441:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:11335:x1873925602608128:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:3.0:1787115019.029460:0:6578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115019.029480:0:6578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c8cff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1654 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.029543:0:6578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a910b37/0x194cd781e88c8cf8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d164d expref: 7 pid: 11900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.029553:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115019.029557:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115019.029563:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c8cff lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1654 expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.029803:0:6578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a910b37/0x194cd781e88c8cf8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d164d expref: 7 pid: 11900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.029821:0:6578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a910b37/0x194cd781e88c8cf8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d164d expref: 7 pid: 11900 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115019.029836:0:6578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6578:1873925624635904:192.168.202.10@tcp:104: 00000100:00100000:3.0:1787115019.030136:0:6578:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f0edd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787115019.045646:0:6578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6578:1873925624635904:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787115019.045688:0:6578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c8cff lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1654 expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.045713:0:6578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041682000, rc 0) 00000100:00100000:3.0:1787115019.045780:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:11335:x1873925602608128:12345-192.168.202.10@tcp:101:bash.0 Request processed in 16339us (16732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115019.045789:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 48 00000100:00100000:2.0:1787115019.050521:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115019.050630:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602608256 00000100:00100000:0.0:1787115019.050651:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602608256 00010000:00010000:0.0:1787115019.050694:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a910b37/0x194cd781e88c8cf8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d164d expref: 7 pid: 11900 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115019.050745:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 60 00000100:00100000:0.0:1787115019.050756:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2363:x1873925602608256:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787115019.050772:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787115019.050796:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a910b37/0x194cd781e88c8cf8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d164d expref: 7 pid: 11900 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.050810:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a910b37/0x194cd781e88c8cf8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d164d expref: 7 pid: 11900 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.050834:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a910b37/0x194cd781e88c8cf8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d164d expref: 7 pid: 11900 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.050850:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787115019.050864:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787115019.050873:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c8cff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1654 expref: 6 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.050884:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c8cff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1654 expref: 6 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.050942:0:5771:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c8cff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1654 expref: 6 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115019.050958:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb72680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5771:1873925624636032:192.168.202.10@tcp:105: 00000100:00100000:0.0:1787115019.051062:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5faa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787115019.054026:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb72680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5771:1873925624636032:192.168.202.10@tcp:105: 00010000:00010000:0.0:1787115019.054053:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787115019.054350:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2363:x1873925602608256:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 3593us (3840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115019.054363:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 60 00000100:00100000:0.0:1787115019.063792:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115019.063900:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602608512 00000100:00100000:3.0:1787115019.063911:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602608512 00000100:00100000:3.0:1787115019.063983:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 36 00000100:00100000:3.0:1787115019.064307:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:11335:x1873925602608512:12345-192.168.202.10@tcp:35:bash.0 00000100:00100000:1.0:1787115019.065999:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+19:11335:x1873925602608512:12345-192.168.202.10@tcp:35:bash.0 Request processed in 1689us (2209us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787115019.069267:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 36 00000100:00100000:0.0:1787115019.143589:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115019.143628:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602608768 00000100:00100000:0.0:1787115019.143638:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602608768 00000100:00100000:0.0:1787115019.143692:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 144 00000100:00100000:0.0:1787115019.143702:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+19:11345:x1873925602608768:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1787115019.143727:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115019.143748:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8d06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d165b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115019.143870:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787115019.144036:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8d06 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d165b expref: 21 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.144051:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af044d99800) 00010000:00010000:0.0:1787115019.144065:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787115019.144071:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8d06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d165b expref: 21 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.144085:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030a00, rc 0) 00000100:00100000:0.0:1787115019.144189:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+20:11345:x1873925602608768:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 487us (613us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1787115019.144196:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 144 00000100:00100000:2.0:1787115019.155090:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115019.161151:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602609024 00000100:00100000:0.0:1787115019.161168:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602609024 00000100:00100000:0.0:1787115019.161225:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 37 00000100:00100000:0.0:1787115019.161236:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+20:11345:x1873925602609024:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:0.0:1787115019.161664:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+21:11345:x1873925602609024:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 428us (6581us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787115019.161673:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 37 00000001:00080000:1.0:1787115019.225462:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00000100:00100000:0.0:1787115019.234453:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115019.234555:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602609152 00000100:00100000:3.0:1787115019.234634:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602609152 00000100:00100000:3.0:1787115019.234748:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 145 00000100:00100000:3.0:1787115019.234759:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+17:11351:x1873925602609152:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1787115019.234786:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115019.234808:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c8d14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1662 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.234894:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8d1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.234909:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.234921:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787115019.235230:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787115019.235235:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787115019.235318:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.235347:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c8d14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1662 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.235364:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8d1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1662 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.235381:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:3.0:1787115019.235384:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787115019.235387:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041682c00, rc 0) 00000100:00100000:3.0:1787115019.235446:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:11351:x1873925602609152:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 688us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115019.235454:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 145 00000100:00100000:2.0:1787115019.239014:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115019.239202:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602609408 00000100:00100000:1.0:1787115019.239213:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602609408 00000100:00100000:1.0:1787115019.239280:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 146 00000100:00100000:1.0:1787115019.239290:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:11351:x1873925602609408:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1787115019.239315:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115019.239336:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8d22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1669 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.239448:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8d29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.239464:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8d29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.239477:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8d29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787115019.239491:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787115019.239729:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8d22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1669 expref: 21 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.239748:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8d29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1669 expref: 20 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.239776:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af044d99200) 00010000:00010000:1.0:1787115019.239779:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787115019.239783:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0800, rc 0) 00000100:00100000:1.0:1787115019.239910:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+20:11351:x1873925602609408:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 619us (903us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1787115019.239918:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 146 00000100:00100000:1.0:1787115019.245731:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115019.246036:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115019.246262:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602609792 00000100:00100000:2.0:1787115019.246272:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602609792 00000100:00100000:2.0:1787115019.246329:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00100000:2.0:1787115019.246338:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+20:2364:x1873925602609792:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115019.246355:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115019.246394:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8d29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1669 expref: 20 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.246415:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af044d99200) 00010000:00010000:2.0:1787115019.246420:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115019.246480:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+19:2364:x1873925602609792:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 143us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115019.246488:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00100000:3.0:1787115019.249261:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602609664 00000100:00100000:3.0:1787115019.249277:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602609664 00000100:00100000:3.0:1787115019.249333:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 147 00000100:00100000:3.0:1787115019.249343:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+19:11351:x1873925602609664:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1787115019.249369:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115019.249389:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c8d37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1670 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.249488:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8d3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.249504:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8d3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.249516:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8d3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787115019.249529:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787115019.249681:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c8d37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1670 expref: 22 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.249720:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8d3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1670 expref: 21 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.249729:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af044d99200) 00010000:00010000:3.0:1787115019.249733:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787115019.249738:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041683000, rc 0) 00000100:00100000:3.0:1787115019.249798:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+21:11351:x1873925602609664:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 456us (4077us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787115019.249806:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 147 00000100:00100000:1.0:1787115019.257835:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115019.257985:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602609920 00000100:00100000:3.0:1787115019.257998:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602609920 00000100:00100000:3.0:1787115019.258069:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 49 00000100:00100000:3.0:1787115019.258080:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2362:x1873925602609920:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:3.0:1787115019.258165:0:6576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024bdce3b/0x194cd781e88c8d4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.258188:0:6576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c8cff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1654 expref: 6 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.258197:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115019.258202:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787115019.258207:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024bdce3b/0x194cd781e88c8d4c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.258244:0:6576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c8cff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1654 expref: 6 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.258276:0:6576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c8cff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1654 expref: 6 pid: 6578 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115019.258293:0:6576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6576:1873925624636160:192.168.202.10@tcp:104: 00000100:00100000:3.0:1787115019.258397:0:6576:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f0ed900 going to sleep for 11 seconds 00000100:00100000:3.0:1787115019.260411:0:6576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6576:1873925624636160:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787115019.260442:0:6576:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024bdce3b/0x194cd781e88c8d4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115019.260925:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115019.261007:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602610048 00000100:00100000:2.0:1787115019.261015:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602610048 00002000:00100000:2.0:1787115019.261071:0:6583:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8af07b6a6680 x1873925602610048/t0(0) o4->6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp:585/0 lens 504/0 e 0 to 0 dl 1787115030 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787115019.261082:0:6583:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af07b6a6680 with x1873925602610048 ext(0->12) 00010000:00010000:2.0:1787115019.261089:0:6583:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c8cff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1654 expref: 7 pid: 6578 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.261157:0:6583:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c8cff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1654 expref: 7 pid: 6578 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787115019.261165:0:6583:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8af07b6a6680 00000100:00100000:2.0:1787115019.261193:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 2 00000100:00100000:2.0:1787115019.261203:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2363:x1873925602610048:12345-192.168.202.10@tcp:4:lfs.0 00000100:00100000:2.0:1787115019.261736:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:2363:x1873925602610048:12345-192.168.202.10@tcp:4:lfs.0 Request processed in 533us (812us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787115019.261746:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 2 00002000:00100000:2.0:1787115019.261755:0:6583:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8af07b6a6680 x1873925602610048/t4294967305(0) o4->6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp:585/0 lens 504/448 e 0 to 0 dl 1787115030 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787115019.261767:0:6583:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af07b6a6680 with x1873925602610048 ext(0->12) 00010000:00010000:2.0:1787115019.261774:0:6583:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c8cff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1654 expref: 9 pid: 6578 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.261785:0:6583:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c8cff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1654 expref: 9 pid: 6578 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787115019.261791:0:6583:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8af07b6a6680 00000100:00100000:2.0:1787115019.265340:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115019.266847:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602610176 00000100:00100000:1.0:1787115019.266874:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602610176 00010000:00010000:1.0:1787115019.266925:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c8cff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1654 expref: 9 pid: 6578 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115019.267034:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 61 00000100:00100000:1.0:1787115019.267044:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:2362:x1873925602610176:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787115019.267061:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787115019.267084:0:5772:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787115019.267087:0:5772:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787115019 00002000:00010000:1.0:1787115019.267089:0:5772:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787115020 00002000:00010000:1.0:1787115019.267091:0:5772:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787115019 00010000:00010000:1.0:1787115019.267099:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c8cff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1654 expref: 9 pid: 6578 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.267157:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c8cff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1654 expref: 9 pid: 6578 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.267184:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c8cff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1654 expref: 9 pid: 6578 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.267204:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787115019.267209:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787115019.267215:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024bdce3b/0x194cd781e88c8d4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.267227:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024bdce3b/0x194cd781e88c8d4c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.267264:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787115019.267391:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2362:x1873925602610176:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 347us (2062us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115019.267399:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 61 00010000:00010000:3.0:1787115019.267462:0:6576:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024bdce3b/0x194cd781e88c8d4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.267472:0:6576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024bdce3b/0x194cd781e88c8d4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.267498:0:6576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024bdce3b/0x194cd781e88c8d4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.267507:0:6576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024bdce3b/0x194cd781e88c8d4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.267515:0:6576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024bdce3b/0x194cd781e88c8d4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.267537:0:6576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682400 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:3.0:1787115019.267541:0:6576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024bdce3b/0x194cd781e88c8d4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.267550:0:6576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024bdce3b/0x194cd781e88c8d4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.267562:0:6576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024bdce3b/0x194cd781e88c8d4c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115019.267580:0:6576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024bdce3b/0x194cd781e88c8d4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115019.267635:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2362:x1873925602609920:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 9557us (9814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115019.267643:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 49 00000100:00100000:0.0:1787115019.270794:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115019.270937:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602610432 00000100:00100000:2.0:1787115019.270945:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602610432 00000100:00100000:2.0:1787115019.270996:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 38 00000100:00100000:2.0:1787115019.271003:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af066349450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+21:11351:x1873925602610432:12345-192.168.202.10@tcp:35:lfs.0 00000004:00010000:2.0:1787115019.271057:0:5789:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8d3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1670 expref: 21 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787115019.271419:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1787115019.271534:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1787115019.272450:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1787115019.272516:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.272531:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8cea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1646 expref: 25 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.272537:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d53 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.272585:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8cea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1646 expref: 25 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.272599:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8cea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1646 expref: 25 pid: 5786 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115019.272609:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b68ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5789:1873925624636288:192.168.202.10@tcp:104: 00000100:00100000:2.0:1787115019.272731:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051399f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787115019.274460:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b68ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5789:1873925624636288:192.168.202.10@tcp:104: 00010000:00010000:0.0:1787115019.274490:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115019.274809:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115019.275039:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602610560 00000100:00100000:2.0:1787115019.275048:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602610560 00010000:00010000:2.0:1787115019.275086:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8cea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1646 expref: 26 pid: 5786 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115019.275171:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 62 00000100:00100000:2.0:1787115019.275180:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c15b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+26:2363:x1873925602610560:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115019.275198:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115019.275206:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8cea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1646 expref: 26 pid: 5786 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.275219:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8cea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1646 expref: 26 pid: 5786 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.275242:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8cea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1646 expref: 26 pid: 5786 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.275260:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af044d99200) 00010000:00010000:2.0:1787115019.275280:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.275290:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.275298:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d53 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.275329:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115019.275381:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c15b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+25:2363:x1873925602610560:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 202us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115019.275388:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 62 00010000:00010000:0.0:1787115019.275800:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.275810:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787115019.275971:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1787115019.276420:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1787115019.276588:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c159880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1873925624636416:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787115019.276656:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115019.276737:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5fa780 going to sleep for 11 seconds 00000100:00100000:1.0:1787115019.277242:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624636416 00000100:00100000:1.0:1787115019.277249:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624636416 00000100:00100000:1.0:1787115019.277955:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787115019.277966:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5789:x1873925624636416:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787115019.278069:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5789:x1873925624636416:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 104us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115019.278076:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787115019.278185:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787115019.278817:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c159880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1873925624636416:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787115019.279335:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1787115019.279414:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c159880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1873925624636544:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787115019.279464:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115019.279491:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5faf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787115019.279611:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624636544 00000100:00100000:1.0:1787115019.279617:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624636544 00000100:00100000:1.0:1787115019.279647:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787115019.279654:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c15a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5789:x1873925624636544:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787115019.279818:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c15a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5789:x1873925624636544:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 162us (352us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787115019.279826:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787115019.280294:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c159880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1873925624636544:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787115019.280362:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1787115019.280404:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.280415:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d53 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.280422:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.280429:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115019.280434:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.280442:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d53 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.280472:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af044d99200) 00010000:00010000:0.0:1787115019.280475:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787115019.280481:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d53 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.280487:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d53 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787115019.280665:0:5789:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787115019.280806:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1787115019.280817:0:5789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 348266709150ns, next at 349266706699ns, rc = 0 00000001:00080000:0.0:1787115019.280824:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1787115019.280869:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af044d99200) 00010000:00010000:0.0:1787115019.280872:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787115019.280879:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8d3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1670 expref: 29 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115019.281085:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af066349450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+28:11351:x1873925602610432:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 10079us (10299us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1787115019.281096:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 38 00000020:00080000:0.0:1787115019.281101:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787115019.286938:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115019.287099:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602610688 00000100:00100000:1.0:1787115019.287221:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602610688 00000100:00100000:1.0:1787115019.287304:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 148 00000100:00100000:1.0:1787115019.287315:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+28:11351:x1873925602610688:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1787115019.287341:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115019.287368:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8d5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1677 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.287434:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8d5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1677 expref: 29 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.287450:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8d5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1677 expref: 29 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.287468:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:1.0:1787115019.287471:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787115019.287475:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0e00, rc 0) 00000100:00100000:1.0:1787115019.287541:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+29:11351:x1873925602610688:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 228us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115019.287548:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 148 00000100:00100000:2.0:1787115019.290801:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115019.291036:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602610944 00000100:00100000:1.0:1787115019.291046:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602610944 00000100:00100000:1.0:1787115019.291103:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 39 00000100:00100000:1.0:1787115019.291148:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+29:11351:x1873925602610944:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:1.0:1787115019.291738:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+30:11351:x1873925602610944:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 592us (944us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1787115019.291747:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 39 00000100:00100000:0.0:1787115019.388343:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115019.388439:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602611200 00000100:00100000:3.0:1787115019.388450:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602611200 00000100:00100000:3.0:1787115019.388509:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 149 00000100:00100000:3.0:1787115019.388519:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+30:11361:x1873925602611200:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1787115019.388543:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115019.388564:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c8d61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d167e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787115019.388905:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787115019.389900:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c8d61 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d167e expref: 32 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.389931:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af044d99800) 00010000:00010000:2.0:1787115019.389935:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787115019.389941:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c8d61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d167e expref: 32 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.389958:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041682400, rc 0) 00000100:00100000:2.0:1787115019.390045:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+31:11361:x1873925602611200:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1527us (1711us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1787115019.390055:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 149 00000100:00100000:0.0:1787115019.392508:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115019.392585:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602611328 00000100:00100000:2.0:1787115019.392594:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602611328 00000100:00100000:2.0:1787115019.392667:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 150 00000100:00100000:2.0:1787115019.392688:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f19b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+31:11361:x1873925602611328:12345-192.168.202.10@tcp:34:lfs.0 00010000:00010000:2.0:1787115019.392763:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.392779:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.392791:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.392805:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8d76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.392813:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.392819:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393181:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8d7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393190:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393198:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787115019.393239:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393252:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393264:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393271:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393277:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115019.393282:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393290:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393302:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:2.0:1787115019.393305:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115019.393309:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393315:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393331:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393337:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8d76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393343:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8d76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393348:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115019.393358:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8d76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393365:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8d76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393374:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8af0514c6600) 00010000:00010000:2.0:1787115019.393377:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115019.393380:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8d76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393386:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8d76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393402:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393408:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8d7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393414:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8d7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393419:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216f800 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115019.393422:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8d7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393428:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8d7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393436:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:2.0:1787115019.393438:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115019.393448:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8d7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.393454:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8d7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115019.393542:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f19b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+31:11361:x1873925602611328:12345-192.168.202.10@tcp:34:lfs.0 Request processed in 854us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115019.393550:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 150 00000100:00100000:1.0:1787115019.398716:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115019.398898:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602611584 00000100:00100000:0.0:1787115019.398909:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602611584 00000100:00100000:0.0:1787115019.398967:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 40 00000100:00100000:0.0:1787115019.398976:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+31:11361:x1873925602611584:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:0.0:1787115019.399783:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+32:11361:x1873925602611584:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 803us (1072us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787115019.399793:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 40 00000100:00100000:0.0:1787115019.434528:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115019.434646:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602611840 00000100:00100000:2.0:1787115019.434665:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602611840 00000100:00100000:2.0:1787115019.434725:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 151 00000100:00100000:2.0:1787115019.434735:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+32:11364:x1873925602611840:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1787115019.434760:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115019.434783:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8d84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1685 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.434876:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8d8b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.434892:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8d8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.434905:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8d8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.434920:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.434927:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.434952:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.435326:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8d99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.435335:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8d99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.435343:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8d99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115019.435354:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787115019.435447:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8d8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.435456:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8d8b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.435463:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8d8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.435470:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115019.435475:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8d8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.435482:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8d8b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.435495:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:2.0:1787115019.435499:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115019.435512:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8d8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.435519:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8d8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.435535:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.435541:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.435548:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.435553:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115019.435555:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.435561:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.435568:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8af0514c6600) 00010000:00010000:2.0:1787115019.435570:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115019.435573:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.435578:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8d92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.435618:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8d84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1685 expref: 35 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.435643:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8d99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1685 expref: 34 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.435652:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:2.0:1787115019.435655:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787115019.435657:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216e800, rc 0) 00000100:00100000:2.0:1787115019.435736:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+34:11364:x1873925602611840:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1002us (1221us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787115019.435745:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 151 00000100:00100000:2.0:1787115019.440532:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115019.440616:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602611968 00000100:00100000:0.0:1787115019.440627:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602611968 00000100:00100000:0.0:1787115019.440702:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 152 00000100:00100000:0.0:1787115019.440713:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+34:11364:x1873925602611968:12345-192.168.202.10@tcp:54:lfs.0 00010000:00010000:0.0:1787115019.440790:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8da7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.440808:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.440821:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.440864:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.440872:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8da7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.440880:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8da7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.440886:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040031600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115019.440890:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8da7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.440920:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8da7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.440934:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:0.0:1787115019.440937:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787115019.440942:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8da7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.440949:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8da7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115019.441037:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+34:11364:x1873925602611968:12345-192.168.202.10@tcp:54:lfs.0 Request processed in 326us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115019.441044:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 152 00000100:00100000:0.0:1787115019.443024:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115019.443101:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602612224 00000100:00100000:2.0:1787115019.443141:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602612224 00000100:00100000:2.0:1787115019.443496:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 41 00000100:00100000:2.0:1787115019.443509:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+34:11364:x1873925602612224:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:2.0:1787115019.443787:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+35:11364:x1873925602612224:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 281us (781us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787115019.443796:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 41 00010000:00010000:3.0:1787115019.590172:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787115019.651531:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115019.651578:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115019.651633:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115019.651667:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115019.651693:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115019.651727:0:11535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602612608 00000100:00100000:2.0:1787115019.651739:0:11535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602612608 00000100:00100000:2.0:1787115019.651790:0:11535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602612736 00000100:00100000:2.0:1787115019.651809:0:11535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602612736 00000100:00100000:2.0:1787115019.651881:0:11535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 74 00000100:00100000:2.0:1787115019.651893:0:11535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2362:x1873925602612608:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787115019.651979:0:11535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2362:x1873925602612608:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 88us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115019.651987:0:11535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 74 00000100:00100000:2.0:1787115019.652003:0:11535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 75 00000100:00100000:2.0:1787115019.652009:0:11535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2362:x1873925602612736:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787115019.652184:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602612864 00000100:00100000:1.0:1787115019.652188:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602612864 00000100:00100000:1.0:1787115019.652217:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602612480 00000100:00100000:1.0:1787115019.652220:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602612480 00000100:00100000:1.0:1787115019.652239:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 165 00000100:00100000:1.0:1787115019.652246:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602612864:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787115019.652278:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067b55fc-03d7-46d6-801a-48936d919d16+5:2362:x1873925602612864:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 34us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115019.652285:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 165 00000100:00100000:1.0:1787115019.652298:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 166 00000100:00100000:1.0:1787115019.652304:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+35:2362:x1873925602612480:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787115019.652333:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+35:2362:x1873925602612480:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 29us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115019.652339:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 166 00000100:00080000:1.0:1787115019.652377:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787115019.653339:0:11535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2362:x1873925602612736:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 1327us (1643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115019.653348:0:11535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 75 00000100:00100000:3.0:1787115019.653754:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602612352 00000100:00100000:3.0:1787115019.653762:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602612352 00000100:00100000:3.0:1787115019.653816:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 297 00000100:00100000:3.0:1787115019.653825:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05136a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602612352:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787115019.653882:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05136a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2362:x1873925602612352:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 59us (2365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115019.653889:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 297 00000100:00100000:0.0:1787115019.688741:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115019.688874:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602613120 00000100:00100000:1.0:1787115019.688886:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602613120 00000100:00100000:1.0:1787115019.688958:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 153 00000100:00100000:1.0:1787115019.688970:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+35:11395:x1873925602613120:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1787115019.689010:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115019.689049:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c8dae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d168c expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.689207:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8db5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.689222:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8db5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.689234:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8db5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787115019.689245:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787115019.689372:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c8dae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d168c expref: 38 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.689389:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8db5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d168c expref: 37 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.689399:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:1.0:1787115019.689402:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787115019.689405:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a1a00, rc 0) 00000100:00100000:1.0:1787115019.689467:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+37:11395:x1873925602613120:12345-192.168.202.10@tcp:101:cat.0 Request processed in 499us (738us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787115019.689474:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 153 00000100:00100000:2.0:1787115019.692653:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115019.692746:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602613376 00000100:00100000:0.0:1787115019.692757:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602613376 00000100:00100000:0.0:1787115019.692811:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 42 00000100:00100000:0.0:1787115019.692821:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+37:11395:x1873925602613376:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:0.0:1787115019.693183:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+38:11395:x1873925602613376:12345-192.168.202.10@tcp:35:cat.0 Request processed in 362us (540us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787115019.693191:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 42 00000100:00100000:0.0:1787115019.697246:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115019.697365:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602613504 00000100:00100000:2.0:1787115019.697377:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602613504 00000100:00100000:2.0:1787115019.697457:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12 00000100:00100000:2.0:1787115019.697469:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+38:2363:x1873925602613504:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115019.697487:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115019.697518:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8db5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d168c expref: 38 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.697539:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:2.0:1787115019.697545:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115019.697609:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+37:2363:x1873925602613504:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 143us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115019.697618:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12 00000100:00100000:2.0:1787115019.778323:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115019.778444:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602613760 00000100:00100000:0.0:1787115019.778457:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602613760 00000100:00100000:0.0:1787115019.778529:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 154 00000100:00100000:0.0:1787115019.778539:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+37:11401:x1873925602613760:12345-192.168.202.10@tcp:101:dd.0 00010000:00010000:0.0:1787115019.778580:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115019.778584:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787115019.778611:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8d1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1662 expref: 37 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.778633:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:0.0:1787115019.778638:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787115019.778654:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8dc3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1693 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.778758:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8dca lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.778772:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8d99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1685 expref: 37 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.778780:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8dca lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.778813:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8d99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1685 expref: 37 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115019.778827:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8d99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1685 expref: 37 pid: 7216 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115019.778843:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624636672:192.168.202.10@tcp:104: 00000100:00100000:0.0:1787115019.779073:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06c1c4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787115019.788370:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115019.788680:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602613888 00000100:00100000:1.0:1787115019.788692:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602613888 00010000:00010000:1.0:1787115019.788734:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8d99 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1685 expref: 38 pid: 7216 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115019.788792:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 63 00000100:00100000:1.0:1787115019.788803:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+38:2364:x1873925602613888:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787115019.788819:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787115019.788827:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8d99 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1685 expref: 38 pid: 7216 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.788841:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8d99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1685 expref: 38 pid: 7216 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.788877:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:1.0:1787115019.788882:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8dca lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.788891:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8dca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.788899:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8dca lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.788917:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787115019.788971:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+38:2364:x1873925602613888:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 170us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115019.788978:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 63 00010000:00010000:2.0:1787115019.789883:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8d99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1685 expref: 37 pid: 7216 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115019.789910:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624636672:192.168.202.10@tcp:104: 00010000:00010000:2.0:1787115019.789932:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8dca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.789941:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8dca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.789948:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8dca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115019.789966:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787115019.790240:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8dc3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1693 expref: 38 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.790258:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8dca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1693 expref: 37 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.790267:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:2.0:1787115019.790269:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787115019.790273:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030e00, rc 0) 00000100:00100000:2.0:1787115019.790314:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+37:11401:x1873925602613760:12345-192.168.202.10@tcp:101:dd.0 Request processed in 11777us (12003us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787115019.790322:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 154 00000100:00100000:3.0:1787115019.793670:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115019.793771:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602614144 00000100:00100000:1.0:1787115019.793782:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602614144 00000100:00100000:1.0:1787115019.793857:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 155 00000100:00100000:1.0:1787115019.793869:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+37:11401:x1873925602614144:12345-192.168.202.10@tcp:36:dd.0 00010000:00010000:1.0:1787115019.794248:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8dd8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.794266:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8dd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115019.794277:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8dd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787115019.794333:0:7216:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1787115019.794361:0:7216:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b8113baf reply state 00000000725b1dc7 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8dd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115019.794371:0:7216:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787115019.794462:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+40:11401:x1873925602614144:12345-192.168.202.10@tcp:36:dd.0 Request processed in 595us (799us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1787115019.794471:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 155 00000020:00080000:1.0:1787115019.794476:0:7216:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787115019.800337:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8dd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.800384:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8dd8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.800392:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8dd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.800399:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115019.800404:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8dd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.800412:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8dd8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.800430:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:2.0:1787115019.800433:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115019.800437:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8dd8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115019.800443:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0c00/0x194cd781e88c8dd8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115020.081262:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115020.081824:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602614272 00000100:00100000:2.0:1787115020.081838:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602614272 00000100:00100000:2.0:1787115020.081962:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 156 00000100:00100000:2.0:1787115020.081973:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+39:11415:x1873925602614272:12345-192.168.202.10@tcp:101:stat.0 00010000:00010000:2.0:1787115020.082000:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115020.082031:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8ddf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d169a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.082096:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8de6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.082161:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8de6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.082174:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8de6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.082191:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8ded lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.082198:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.082204:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.082465:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8df4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.082473:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8dca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1693 expref: 40 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.082479:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8df4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.082506:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8dca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1693 expref: 40 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.082516:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8dca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1693 expref: 40 pid: 5787 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115020.082534:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1873925624636800:192.168.202.10@tcp:104: 00000100:00100000:2.0:1787115020.082631:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051399780 going to sleep for 11 seconds 00000100:00080000:1.0:1787115020.083739:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787115020.091717:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1873925624636800:192.168.202.10@tcp:104: 00010000:00010000:2.0:1787115020.091750:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8df4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115020.093319:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115020.093648:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602614528 00000100:00100000:0.0:1787115020.093659:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602614528 00000100:00100000:0.0:1787115020.093724:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 43 00000100:00100000:0.0:1787115020.093736:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+41:5577:x1873925602614528:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787115020.095079:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+42:5577:x1873925602614528:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 1338us (1760us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1787115020.097926:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 43 00000100:00100000:1.0:1787115020.099570:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115020.099886:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602614656 00000100:00100000:2.0:1787115020.099898:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602614656 00010000:00010000:2.0:1787115020.099943:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8dca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1693 expref: 42 pid: 5787 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115020.099989:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 64 00000100:00100000:2.0:1787115020.099998:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+42:2364:x1873925602614656:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115020.100022:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115020.100030:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8dca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1693 expref: 42 pid: 5787 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.100043:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8dca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1693 expref: 42 pid: 5787 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.100067:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8dca lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1693 expref: 42 pid: 5787 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.100084:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:2.0:1787115020.100391:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8df4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.100421:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.100430:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8df4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.100468:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787115020.100602:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.100611:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115020.100673:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787115020.100677:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787115020.100700:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.100715:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.100726:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8de6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.100733:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8de6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.100740:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8de6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.100747:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115020.100759:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8de6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.100768:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8de6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.100778:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:0.0:1787115020.100781:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115020.100785:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8de6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.100792:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8de6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.100807:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.100814:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8ded lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.100820:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8ded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.100826:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115020.100828:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8ded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.100834:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8ded lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.100854:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8af0514c6600) 00010000:00010000:0.0:1787115020.100857:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115020.100868:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8ded lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.100874:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8ded lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.100916:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8ddf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d169a expref: 42 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.100931:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8df4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d169a expref: 41 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.100940:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:0.0:1787115020.100942:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787115020.100944:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216f800, rc 0) 00000100:00100000:2.0:1787115020.100994:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+41:2364:x1873925602614656:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 995us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115020.101003:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 64 00000100:00100000:0.0:1787115020.102543:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+40:11415:x1873925602614272:12345-192.168.202.10@tcp:101:stat.0 Request processed in 20565us (21286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115020.102554:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 156 00000100:00100000:0.0:1787115020.165422:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624637184:0@lo:400:kworker.0 00000100:00100000:0.0:1787115020.165497:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115020.165566:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787115020.165573:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624637056:0@lo:400:kworker.0 00000100:00100000:0.0:1787115020.165597:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115020.165616:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624637568:0@lo:400:kworker.0 00000100:00100000:0.0:1787115020.165640:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115020.165680:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624637568 00000100:00100000:0.0:1787115020.165689:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624637568 00000100:00100000:0.0:1787115020.165747:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787115020.165773:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624637568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787115020.165829:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624637568:12345-0@lo:400:kworker.0 Request processed in 58us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115020.165837:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1787115020.165873:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787115020.165905:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624637568:0@lo:400:kworker.0 00000100:00100000:0.0:1787115020.165932:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624637184 00000100:00100000:0.0:1787115020.165936:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624637184 00000100:00100000:0.0:1787115020.165964:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624637056 00000100:00100000:0.0:1787115020.165967:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624637056 00000100:00100000:0.0:1787115020.165986:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787115020.165993:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624637184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787115020.166044:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624637184:12345-0@lo:400:kworker.0 Request processed in 51us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115020.166051:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787115020.166063:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787115020.166069:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624637056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787115020.166097:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624637056:12345-0@lo:400:kworker.0 Request processed in 28us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115020.166103:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:0.0:1787115020.166146:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787115020.166163:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624637056:0@lo:400:kworker.0 00000100:00100000:0.0:1787115020.166174:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624637184:0@lo:400:kworker.0 00000100:00100000:3.0:1787115020.166331:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624636928:0@lo:400:kworker.0 00000100:00100000:3.0:1787115020.166367:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115020.166403:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624637440:0@lo:400:kworker.0 00000100:00100000:3.0:1787115020.166425:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115020.166441:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787115020.166447:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624637312:0@lo:400:kworker.0 00000100:00100000:3.0:1787115020.166469:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115020.167102:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624636928 00000100:00100000:0.0:1787115020.167137:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624636928 00000100:00100000:0.0:1787115020.167167:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787115020.167195:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624636928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787115020.167242:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624636928:12345-0@lo:400:kworker.0 Request processed in 47us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115020.167248:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787115020.167274:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624637312 00000100:00100000:0.0:1787115020.167277:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624637312 00000100:00100000:0.0:1787115020.167300:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787115020.167306:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1873925624637312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787115020.167333:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1873925624637312:12345-0@lo:400:kworker.0 Request processed in 28us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115020.167339:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787115020.167367:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624637312:0@lo:400:kworker.0 00000100:00100000:0.0:1787115020.167375:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624636928:0@lo:400:kworker.0 00000100:00100000:0.0:1787115020.167396:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624637440 00000100:00100000:0.0:1787115020.167399:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624637440 00000100:00100000:0.0:1787115020.167426:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787115020.167431:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624637440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787115020.167461:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624637440:12345-0@lo:400:kworker.0 Request processed in 30us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115020.167467:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:0.0:1787115020.167479:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787115020.167493:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624637440:0@lo:400:kworker.0 00000100:00100000:2.0:1787115020.174744:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787115020.174772:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624637696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787115020.174863:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115020.174964:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624637696 00000100:00100000:3.0:1787115020.174973:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624637696 00000100:00100000:3.0:1787115020.175037:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787115020.175048:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1873925624637696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787115020.175074:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787115020.175183:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1873925624637696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115020.175191:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787115020.175242:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624637696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787115020.194330:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115020.194460:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602614912 00000100:00100000:0.0:1787115020.194471:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602614912 00000100:00100000:0.0:1787115020.194529:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 157 00000100:00100000:0.0:1787115020.194536:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+40:11420:x1873925602614912:12345-192.168.202.10@tcp:36:truncate.0 00010000:00010000:0.0:1787115020.194604:0:7216:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787115020.194639:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8df4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d169a expref: 40 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.194659:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:0.0:1787115020.194662:0:7216:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787115020.194875:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8dfb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.194895:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8dfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.194906:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8dfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787115020.194962:0:7216:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1787115020.194987:0:7216:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f45b6fe9 reply state 00000000748a9147 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8dfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115020.194996:0:7216:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787115020.195681:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+42:11420:x1873925602614912:12345-192.168.202.10@tcp:36:truncate.0 Request processed in 1139us (1352us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787115020.195692:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 157 00000020:00080000:0.0:1787115020.195697:0:7216:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787115020.197068:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8dfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.197086:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8dfb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.197093:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8dfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.197223:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115020.197229:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8dfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.197236:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8dfb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.197253:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:0.0:1787115020.197257:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115020.197261:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8dfb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.197267:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8dfb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115020.368718:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115020.369763:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602615040 00000100:00100000:0.0:1787115020.369777:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602615040 00000100:00100000:0.0:1787115020.369859:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 158 00000100:00100000:0.0:1787115020.369870:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+41:11435:x1873925602615040:12345-192.168.202.10@tcp:101:stat.0 00010000:00010000:0.0:1787115020.369906:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115020.369927:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8e02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d16a1 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370019:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8e09 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370286:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8e09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370299:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8e09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370321:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370329:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370335:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370650:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8e17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370659:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8e17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370665:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8e17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115020.370698:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787115020.370702:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787115020.370720:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8e17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370730:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8e17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370737:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8e09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370742:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8e09 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370756:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8e09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370762:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115020.370765:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8e09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370772:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8e09 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370782:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:0.0:1787115020.370785:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115020.370788:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8e09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370794:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8e09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370805:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370810:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370815:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370818:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115020.370820:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370832:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.370838:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8af051ecb500) 00010000:00010000:0.0:1787115020.371658:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115020.371665:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.371673:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.371716:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8e02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16a1 expref: 43 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.371729:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8e17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16a1 expref: 42 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.371738:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:0.0:1787115020.371740:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787115020.371743:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040031600, rc 0) 00000100:00100000:0.0:1787115020.371821:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+42:11435:x1873925602615040:12345-192.168.202.10@tcp:101:stat.0 Request processed in 1953us (3113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115020.371830:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 158 00000100:00100000:1.0:1787115020.525157:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115020.527008:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602615296 00000100:00100000:2.0:1787115020.527022:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602615296 00000100:00100000:2.0:1787115020.527091:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 159 00000100:00100000:2.0:1787115020.527101:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+42:11445:x1873925602615296:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1787115020.527138:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115020.527161:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8e1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d16a8 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115020.527452:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787115020.527896:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8e1e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16a8 expref: 44 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.527911:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af044d99800) 00010000:00010000:2.0:1787115020.527913:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787115020.527926:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8e1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16a8 expref: 44 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.527941:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216f200, rc 0) 00000100:00100000:2.0:1787115020.528070:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+43:11445:x1873925602615296:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 969us (2969us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787115020.528079:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 159 00000100:00100000:1.0:1787115020.533730:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115020.533961:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602615552 00000100:00100000:0.0:1787115020.533973:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602615552 00000100:00100000:0.0:1787115020.534045:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 44 00000100:00100000:0.0:1787115020.534057:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06634a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+43:11445:x1873925602615552:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:0.0:1787115020.536830:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06634a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+44:11445:x1873925602615552:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 1676us (2010us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787115020.536860:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 44 00010000:00010000:3.0:1787115020.613295:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787115020.628238:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115020.628305:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602615808 00000100:00100000:0.0:1787115020.628422:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602615808 00000100:00100000:0.0:1787115020.628536:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 160 00000100:00100000:0.0:1787115020.628547:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+44:11451:x1873925602615808:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:0.0:1787115020.628573:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115020.628595:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8e2c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d16af expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.628697:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e33 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.628709:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8e17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16a1 expref: 45 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.628715:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e33 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.628742:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8e17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16a1 expref: 45 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.628752:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8e17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16a1 expref: 45 pid: 5785 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115020.628761:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af045057800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1873925624637824:192.168.202.10@tcp:104: 00000100:00100000:0.0:1787115020.628897:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050faa6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787115020.631582:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115020.631627:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602615936 00000100:00100000:2.0:1787115020.631637:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602615936 00010000:00010000:2.0:1787115020.631678:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8e17 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16a1 expref: 46 pid: 5785 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115020.631767:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 65 00000100:00100000:0.0:1787115020.631767:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af045057800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1873925624637824:192.168.202.10@tcp:104: 00000100:00100000:2.0:1787115020.631777:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+46:2363:x1873925602615936:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787115020.631789:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e33 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.631791:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115020.631798:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8e17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16a1 expref: 46 pid: 5785 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.631810:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8e17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16a1 expref: 46 pid: 5785 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.631833:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8e17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16a1 expref: 46 pid: 5785 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.631865:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:2.0:1787115020.631870:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e33 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.631905:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.631913:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e33 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.631943:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115020.632011:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+45:2363:x1873925602615936:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 234us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115020.632018:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 65 00010000:00010000:0.0:1787115020.632483:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.632491:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115020.632510:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787115020.632670:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c8e2c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16af expref: 46 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.632688:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e33 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16af expref: 45 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.632696:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:0.0:1787115020.632698:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787115020.632701:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030200, rc 0) 00000100:00100000:0.0:1787115020.632743:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+45:11451:x1873925602615808:12345-192.168.202.10@tcp:101:bash.0 Request processed in 4198us (4512us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1787115020.632750:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 160 00000100:00100000:1.0:1787115020.635683:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115020.635749:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602616192 00000100:00100000:0.0:1787115020.635758:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602616192 00000100:00100000:0.0:1787115020.635808:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 161 00000100:00100000:0.0:1787115020.635819:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+45:11451:x1873925602616192:12345-192.168.202.10@tcp:36:bash.0 00010000:00010000:0.0:1787115020.636127:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8e41 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.636144:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8e41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.636156:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8e41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787115020.636206:0:7216:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1787115020.636223:0:7216:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003c88f794 reply state 0000000018eade57 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8e41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115020.636230:0:7216:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787115020.636312:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+48:11451:x1873925602616192:12345-192.168.202.10@tcp:36:bash.0 Request processed in 494us (640us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1787115020.636327:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 161 00000020:00080000:0.0:1787115020.636332:0:7216:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787115020.639097:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8e41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.639133:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8e41 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.639141:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8e41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.639147:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115020.639151:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8e41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.639158:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8e41 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.639174:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:2.0:1787115020.639177:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115020.639182:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8e41 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.639207:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8e41 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115020.640388:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115020.640665:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602616320 00000100:00100000:2.0:1787115020.640677:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602616320 00000100:00100000:2.0:1787115020.640771:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 162 00000100:00100000:2.0:1787115020.640779:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+47:11451:x1873925602616320:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:2.0:1787115020.640801:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115020.640817:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8e48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d16b6 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.640929:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8e4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.640944:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e33 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16af expref: 48 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.640952:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8e4f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.640999:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e33 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16af expref: 48 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.641022:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e33 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16af expref: 48 pid: 5785 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115020.641036:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624637952:192.168.202.10@tcp:104: 00000100:00100000:2.0:1787115020.641138:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051399780 going to sleep for 11 seconds 00000100:00100000:2.0:1787115020.643018:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624637952:192.168.202.10@tcp:104: 00010000:00010000:2.0:1787115020.643040:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8e4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115020.643631:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115020.643749:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602616448 00000100:00100000:2.0:1787115020.643756:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602616448 00010000:00010000:2.0:1787115020.643783:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e33 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16af expref: 49 pid: 5785 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115020.643808:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 66 00000100:00100000:2.0:1787115020.643815:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+49:2364:x1873925602616448:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115020.643827:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115020.643832:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e33 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16af expref: 49 pid: 5785 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.643852:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e33 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16af expref: 49 pid: 5785 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.643875:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8e33 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16af expref: 49 pid: 5785 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.643893:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:2.0:1787115020.644237:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8e4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.644249:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8e4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.644257:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8e4f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.644302:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787115020.644456:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8e4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.644463:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8e4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115020.644504:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787115020.644507:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787115020.644525:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8e4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.644551:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8e48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16b6 expref: 49 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.644572:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8e4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16b6 expref: 48 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.644578:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:0.0:1787115020.644580:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787115020.644582:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216f800, rc 0) 00000100:00100000:0.0:1787115020.644627:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+48:11451:x1873925602616320:12345-192.168.202.10@tcp:101:bash.0 Request processed in 3848us (4247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115020.644634:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 162 00000100:00100000:2.0:1787115020.644684:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+47:2364:x1873925602616448:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 869us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115020.644690:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 66 00000100:00100000:3.0:1787115020.647378:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115020.647449:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602616704 00000100:00100000:2.0:1787115020.647458:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602616704 00000100:00100000:2.0:1787115020.647504:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 45 00000100:00100000:2.0:1787115020.647514:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+47:11451:x1873925602616704:12345-192.168.202.10@tcp:35:bash.0 00000100:00100000:2.0:1787115020.647772:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+48:11451:x1873925602616704:12345-192.168.202.10@tcp:35:bash.0 Request processed in 259us (461us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1787115020.647778:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 45 00000100:00100000:3.0:1787115020.683261:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787115020.683453:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af045057800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624638080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787115020.683520:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115020.683634:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624638080 00000100:00100000:0.0:1787115020.683643:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624638080 00000100:00100000:0.0:1787115020.683727:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787115020.683738:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624638080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787115020.683774:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787115020.683834:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624638080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115020.683852:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787115020.683917:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af045057800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624638080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787115020.726047:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115020.726090:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602616960 00000100:00100000:3.0:1787115020.726100:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602616960 00000100:00100000:3.0:1787115020.726182:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 163 00000100:00100000:3.0:1787115020.726193:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+48:11461:x1873925602616960:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1787115020.726220:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115020.726240:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c8e56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d16bd expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787115020.726441:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787115020.726606:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c8e56 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16bd expref: 50 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.726621:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af044d99800) 00010000:00010000:3.0:1787115020.726631:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787115020.726638:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c8e56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16bd expref: 50 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.726649:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041682400, rc 0) 00000100:00100000:3.0:1787115020.726709:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+49:11461:x1873925602616960:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 518us (669us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1787115020.726715:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 163 00000100:00100000:1.0:1787115020.732483:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115020.732646:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602617088 00000100:00100000:3.0:1787115020.732656:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602617088 00000100:00100000:3.0:1787115020.732835:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 164 00000100:00100000:3.0:1787115020.732868:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+49:11461:x1873925602617088:12345-192.168.202.10@tcp:34:lfs.0 00010000:00010000:3.0:1787115020.733012:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8e64 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733052:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8e64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733068:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8e64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733086:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8e6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733094:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8e6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733103:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8e6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733434:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8e72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733451:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733461:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787115020.733507:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733521:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8e64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733529:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8e64 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733536:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8e64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733543:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115020.733547:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8e64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733555:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8e64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733568:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:3.0:1787115020.733572:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115020.733576:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8e64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733583:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8e64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733605:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8e6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733611:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8e6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733618:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8e6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733624:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041683000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115020.733628:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8e6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733635:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8e6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733644:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8af044d99100) 00010000:00010000:3.0:1787115020.733646:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115020.733650:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8e6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733656:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8e6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733675:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733682:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8e72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733688:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8e72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733699:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115020.733703:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8e72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733710:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8e72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733719:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:3.0:1787115020.733722:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115020.733725:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8e72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.733730:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8e72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115020.733816:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+49:11461:x1873925602617088:12345-192.168.202.10@tcp:34:lfs.0 Request processed in 952us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115020.733826:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 164 00000100:00100000:2.0:1787115020.736966:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115020.737051:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602617344 00000100:00100000:1.0:1787115020.737060:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602617344 00000100:00100000:1.0:1787115020.737155:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 46 00000100:00100000:1.0:1787115020.737167:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+49:11461:x1873925602617344:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:1.0:1787115020.737587:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+50:11461:x1873925602617344:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 421us (629us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1787115020.737595:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 46 00000001:00080000:0.0:1787115020.740920:0:6604:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1787115020.740941:0:6604:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:0.0:1787115020.775528:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115020.776621:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602617600 00000100:00100000:1.0:1787115020.776636:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602617600 00000100:00100000:1.0:1787115020.776710:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 165 00000100:00100000:1.0:1787115020.776722:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+50:11464:x1873925602617600:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1787115020.776749:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115020.776773:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8e79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d16c4 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115020.776973:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c8e80 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115020.776989:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c8e80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115020.777002:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c8e80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115020.777018:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8e87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115020.777025:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115020.777032:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.778982:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8e8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.779016:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8e8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.779028:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8e8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115020.779050:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787115020.779200:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c8e80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.779209:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c8e80 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.779216:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c8e80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.779222:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115020.779227:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c8e80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.779234:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c8e80 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.779247:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:0.0:1787115020.779249:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115020.779254:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c8e80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.779260:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c8e80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.779272:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.779278:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8e87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.779305:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8e87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.779310:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1a00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115020.779313:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8e87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.779319:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8e87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.779327:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8af0510d6600) 00010000:00010000:0.0:1787115020.779330:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115020.779333:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8e87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.779338:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c8e87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.779388:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c8e79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16c4 expref: 53 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.779402:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8e8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16c4 expref: 52 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.779410:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:0.0:1787115020.779412:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787115020.779415:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030a00, rc 0) 00000100:00100000:0.0:1787115020.779509:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+52:11464:x1873925602617600:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 2788us (3990us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787115020.779525:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 165 00000100:00100000:3.0:1787115020.784429:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115020.784571:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115020.785853:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602617728 00000100:00100000:0.0:1787115020.785866:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602617728 00000100:00100000:0.0:1787115020.785932:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:0.0:1787115020.785943:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+52:2363:x1873925602617728:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787115020.785959:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787115020.785987:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8e8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16c4 expref: 52 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115020.786018:0:6592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:0.0:1787115020.786027:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787115020.786097:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+51:2363:x1873925602617728:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 156us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115020.786124:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:1.0:1787115020.786357:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602617856 00000100:00100000:1.0:1787115020.786362:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602617856 00000100:00100000:1.0:1787115020.786393:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 166 00000100:00100000:1.0:1787115020.786400:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+51:11464:x1873925602617856:12345-192.168.202.10@tcp:54:lfs.0 00010000:00010000:1.0:1787115020.786458:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c8e9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115020.786472:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c8e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115020.786483:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c8e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115020.786510:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c8e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115020.786517:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c8e9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115020.786523:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c8e9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115020.786528:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115020.786533:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c8e9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115020.786540:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c8e9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115020.786549:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:1.0:1787115020.786563:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787115020.786568:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c8e9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115020.786574:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c8e9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115020.786611:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+51:11464:x1873925602617856:12345-192.168.202.10@tcp:54:lfs.0 Request processed in 212us (2192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115020.786618:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 166 00000100:00100000:2.0:1787115020.793165:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115020.794172:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602618112 00000100:00100000:1.0:1787115020.794184:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602618112 00000100:00100000:1.0:1787115020.794247:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 47 00000100:00100000:1.0:1787115020.794268:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+51:11464:x1873925602618112:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:1.0:1787115020.794526:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+52:11464:x1873925602618112:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 268us (1369us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787115020.794534:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 47 00000100:00100000:3.0:1787115020.920266:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115020.920411:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602618368 00000100:00100000:2.0:1787115020.920422:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602618368 00000100:00100000:2.0:1787115020.920481:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 167 00000100:00100000:2.0:1787115020.920490:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+52:11482:x1873925602618368:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:2.0:1787115020.920518:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115020.920542:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8ea3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d16cb expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.920640:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8eaa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.920652:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8eaa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.920677:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8eaa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115020.920689:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787115020.920814:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8ea3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16cb expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.920831:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8eaa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16cb expref: 54 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.920852:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:2.0:1787115020.920855:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787115020.920858:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216e600, rc 0) 00000100:00100000:2.0:1787115020.920927:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+54:11482:x1873925602618368:12345-192.168.202.10@tcp:101:cat.0 Request processed in 437us (671us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1787115020.920932:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 167 00000100:00100000:3.0:1787115020.939995:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115020.940053:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602618496 00000100:00100000:1.0:1787115020.940063:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602618496 00000100:00100000:1.0:1787115020.940208:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 168 00000100:00100000:1.0:1787115020.940220:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+54:11483:x1873925602618496:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1787115020.940246:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115020.940268:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c8eb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d16d2 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115020.940340:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8ebf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115020.940355:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8ebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115020.940383:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8ebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787115020.940570:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787115020.940575:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787115020.940642:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8ebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115020.940668:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c8eb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16d2 expref: 56 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115020.940684:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8ebf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16d2 expref: 55 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115020.940694:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:1.0:1787115020.940697:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787115020.940700:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0800, rc 0) 00000100:00100000:1.0:1787115020.940767:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+55:11483:x1873925602618496:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 549us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115020.940773:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 168 00000100:00100000:3.0:1787115020.944766:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115020.945569:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602618880 00000100:00100000:2.0:1787115020.945583:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602618880 00000100:00100000:2.0:1787115020.945657:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 48 00000100:00100000:2.0:1787115020.945668:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+55:11483:x1873925602618880:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:2.0:1787115020.946033:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+56:11483:x1873925602618880:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 366us (1278us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787115020.946042:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 48 00000100:00100000:0.0:1787115020.948610:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115020.948693:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602619008 00000100:00100000:3.0:1787115020.948703:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602619008 00000100:00100000:3.0:1787115020.948767:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 14 00000100:00100000:3.0:1787115020.948777:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eece680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+56:11483:x1873925602619008:12345-192.168.202.10@tcp:103:lfs.0 00010000:00010000:3.0:1787115020.948793:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787115020.948831:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8e4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16b6 expref: 56 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.948870:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8eaa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16cb expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.948887:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8d5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1677 expref: 54 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.948897:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0510d6200) 00010000:00010000:3.0:1787115020.948909:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787115020.948970:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eece680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+53:11483:x1873925602619008:12345-192.168.202.10@tcp:103:lfs.0 Request processed in 194us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115020.948977:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 14 00000100:00100000:3.0:1787115020.951528:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115020.951615:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602619136 00000100:00100000:2.0:1787115020.951625:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602619136 00000100:00100000:2.0:1787115020.951684:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 169 00000100:00100000:2.0:1787115020.951695:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+53:11483:x1873925602619136:12345-192.168.202.10@tcp:58:lfs.0 00010000:00010000:2.0:1787115020.951850:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8ec6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.951866:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8ec6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115020.951877:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8ec6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787115020.952156:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787115020.952442:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+53:11483:x1873925602619136:12345-192.168.202.10@tcp:58:lfs.0 Request processed in 748us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115020.952451:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 169 00000100:00100000:0.0:1787115020.968987:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115020.969034:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602619264 00000100:00100000:3.0:1787115020.969045:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602619264 00000100:00100000:3.0:1787115020.969194:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 170 00000100:00100000:3.0:1787115020.969205:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+53:11485:x1873925602619264:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1787115020.969237:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115020.969259:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c8ecd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d16d9 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969327:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8ed4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969342:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8ed4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969372:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8ed4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969387:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8edb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969395:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8edb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969401:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8edb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969687:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ee2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969696:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969703:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787115020.969737:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787115020.969741:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787115020.969760:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969771:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969780:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8ed4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969796:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8ed4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969802:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8ed4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969808:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115020.969812:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8ed4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969820:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8ed4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969852:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:3.0:1787115020.969856:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115020.969861:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8ed4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969867:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8ed4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969879:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8edb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969883:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8edb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969887:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8edb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969890:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041683000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115020.969896:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8edb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969901:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8edb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969906:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8af044d99100) 00010000:00010000:3.0:1787115020.969908:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115020.969910:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8edb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969913:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8edb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969938:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c8ecd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16d9 expref: 55 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969946:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ee2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16d9 expref: 54 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115020.969950:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0514c6e00) 00010000:00010000:3.0:1787115020.969952:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787115020.969953:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041682c00, rc 0) 00000100:00100000:3.0:1787115020.970019:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+54:11485:x1873925602619264:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 816us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115020.970026:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 170 00000040:00080000:0.0:1787115021.381489:0:11519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787115021.381499:0:11519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787115021.381589:0:11519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787115021.381596:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787115021.381761:0:11519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11519:1873925624638208:192.168.202.10@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787115021.381888:0:11519:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0438e8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787115021.387812:0:11519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11519:1873925624638208:192.168.202.10@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787115021.392811:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115021.392861:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602619392 00000100:00100000:2.0:1787115021.393056:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602619392 00000100:00100000:2.0:1787115021.393139:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 171 00000100:00100000:2.0:1787115021.393161:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+54:11496:x1873925602619392:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787115021.393198:0:7216:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787115021.393500:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+54:11496:x1873925602619392:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 Request processed in 351us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115021.393508:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 171 00000100:00100000:1.0:1787115021.399697:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115021.400423:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602619520 00000100:00100000:3.0:1787115021.400435:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602619520 00000100:00100000:3.0:1787115021.400515:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 172 00000100:00100000:3.0:1787115021.400527:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+54:11496:x1873925602619520:12345-192.168.202.10@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787115021.400745:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c8ee9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.400763:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c8ee9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.400776:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c8ee9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.400806:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8ef0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.400815:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.400822:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.400947:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8ef7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.400957:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.400965:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787115021.401011:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787115021.401015:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787115021.401028:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.401039:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c8ee9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.401050:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c8ee9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.401057:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c8ee9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.401064:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115021.401068:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c8ee9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.401075:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c8ee9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.401087:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8af0510d6d00) 00010000:00010000:3.0:1787115021.401090:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115021.401095:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c8ee9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.401102:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c8ee9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.401136:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.401143:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8ef0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.401324:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.401329:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041683000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115021.401337:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.401344:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.401352:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8af044d99100) 00010000:00010000:3.0:1787115021.401354:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115021.401357:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8ef0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.401363:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8ef0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.401378:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.401385:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8ef7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.401390:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.401395:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115021.401398:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.401404:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8ef7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.401411:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0514c6e00) 00010000:00010000:3.0:1787115021.401413:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115021.401421:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8ef7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.401426:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8ef7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115021.401577:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+54:11496:x1873925602619520:12345-192.168.202.10@tcp:34:lhsmtool_posix.0 Request processed in 1052us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115021.401587:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 172 00000100:00100000:1.0:1787115021.406094:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115021.406374:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602619776 00000100:00100000:2.0:1787115021.406385:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602619776 00000100:00100000:2.0:1787115021.406437:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 173 00000100:00100000:2.0:1787115021.406449:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+54:11496:x1873925602619776:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787115021.406482:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115021.406505:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8efe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d16e0 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.406602:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.406616:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.406629:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115021.406640:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787115021.406723:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.406729:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.406733:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.406737:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115021.406741:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.406746:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.406767:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0514c6e00) 00010000:00010000:2.0:1787115021.406773:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787115021.406777:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.406782:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.406814:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8efe lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16e0 expref: 56 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.406821:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8af0510d6d00) 00010000:00010000:2.0:1787115021.406823:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787115021.406825:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8efe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16e0 expref: 56 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.406843:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216e800, rc 0) 00000100:00100000:2.0:1787115021.406939:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+55:11496:x1873925602619776:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 492us (853us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1787115021.406947:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 173 00000100:00100000:2.0:1787115021.409482:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115021.409570:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602619904 00000100:00100000:1.0:1787115021.409580:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602619904 00000100:00100000:1.0:1787115021.409661:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 174 00000100:00100000:1.0:1787115021.409673:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+55:11496:x1873925602619904:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787115021.409713:0:5785:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787115021.409925:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+55:11496:x1873925602619904:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 Request processed in 254us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115021.409933:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 174 00000100:00100000:1.0:1787115021.412913:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115021.413048:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602620160 00000100:00100000:3.0:1787115021.413058:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602620160 00000100:00100000:3.0:1787115021.413157:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 175 00000100:00100000:3.0:1787115021.413174:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+55:11496:x1873925602620160:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787115021.413195:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115021.413198:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787115021.413235:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8ebf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16d2 expref: 55 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.413252:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:3.0:1787115021.413257:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787115021.413270:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8f13 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d16e7 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787115021.413871:0:5786:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787115021.414088:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8f1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.414102:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8f1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.414146:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8f1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.414202:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c8f13 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16e7 expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.414215:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8f1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16e7 expref: 56 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.414223:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8af044d99100) 00010000:00010000:3.0:1787115021.414226:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787115021.414228:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041683000, rc 0) 00000100:00100000:3.0:1787115021.414299:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+56:11496:x1873925602620160:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 1126us (1396us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787115021.414306:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 175 00000100:00100000:3.0:1787115021.418877:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115021.419090:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602620416 00000100:00100000:2.0:1787115021.419101:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602620416 00000100:00100000:2.0:1787115021.419177:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 176 00000100:00100000:2.0:1787115021.419187:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+56:11496:x1873925602620416:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787115021.419247:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115021.419277:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c8f1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16e7 expref: 56 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.419309:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8af044d99100) 00010000:00010000:2.0:1787115021.419322:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787115021.419347:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f28 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.419360:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.419370:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.419418:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8f2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb8c45a9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.419424:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8f2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb8c45a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.419428:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8f2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb8c45a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.419651:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.419658:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f28 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.419662:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.419666:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115021.419669:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.419678:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f28 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.419685:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:2.0:1787115021.419687:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115021.419689:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f28 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.419693:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f28 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.419702:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8f2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb8c45a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.419705:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8f2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb8c45a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.419709:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8f2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb8c45a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.419712:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216f800 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115021.419713:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8f2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb8c45a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.419716:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8f2f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb8c45a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.419720:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb8c45a9e (ffff8af0514c6100) 00010000:00010000:2.0:1787115021.419721:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115021.419723:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8f2f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb8c45a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.419731:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8f2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb8c45a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115021.420548:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+55:11496:x1873925602620416:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 Request processed in 1356us (1683us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787115021.420557:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 176 00000100:00100000:2.0:1787115021.430515:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115021.433204:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602620544 00000100:00100000:0.0:1787115021.433233:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602620544 00000100:00100000:0.0:1787115021.433293:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 177 00000100:00100000:0.0:1787115021.433302:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+55:11496:x1873925602620544:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787115021.433347:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115021.433376:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8f36 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d16ee expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.433415:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8f3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.433430:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8f3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.433441:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8f3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.433552:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8f36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16ee expref: 57 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.433571:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8f3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16ee expref: 56 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.433580:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8af051ecb500) 00010000:00010000:0.0:1787115021.433584:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787115021.433588:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030200, rc 0) 00000100:00100000:0.0:1787115021.433666:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+56:11496:x1873925602620544:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 364us (3161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115021.433673:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 177 00000100:00100000:3.0:1787115021.436642:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115021.436699:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602620800 00000100:00100000:1.0:1787115021.436710:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602620800 00000100:00100000:1.0:1787115021.436844:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 178 00000100:00100000:1.0:1787115021.436855:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+56:11496:x1873925602620800:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787115021.437006:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8f44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.437024:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8f44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.437037:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8f44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787115021.437691:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1787115021.437706:0:5785:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 350423598333ns, next at 351423595541ns, rc = 0 00000004:00010000:1.0:1787115021.438001:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ffeabea9 reply state 000000001928d61a transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8f44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115021.438012:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787115021.438398:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+58:11496:x1873925602620800:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 Request processed in 1287us (1510us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1787115021.438408:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 178 00010000:00010000:0.0:1787115021.439984:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8f44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.439999:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8f44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.440024:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8f44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.440031:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0800 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115021.440036:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8f44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.440044:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8f44 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.441571:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8af051ecb500) 00010000:00010000:0.0:1787115021.441583:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787115021.441593:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8f44 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.441603:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c8f44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115021.447793:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115021.447881:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602620928 00000100:00100000:1.0:1787115021.447890:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602620928 00000100:00100000:1.0:1787115021.447951:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 179 00000100:00100000:1.0:1787115021.447961:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+57:11496:x1873925602620928:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787115021.448009:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115021.448033:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c8f4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d16f5 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.448093:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c8f4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16f5 expref: 58 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.448128:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c8f4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16f5 expref: 58 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.448149:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8af051ecb500) 00010000:00010000:1.0:1787115021.448152:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787115021.448156:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a1000, rc 0) 00000100:00100000:1.0:1787115021.448214:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+58:11496:x1873925602620928:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 255us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115021.448222:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 179 00000100:00100000:3.0:1787115021.450768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115021.450896:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602621056 00000100:00100000:1.0:1787115021.450906:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602621056 00000100:00100000:1.0:1787115021.450981:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 50 00000100:00100000:1.0:1787115021.450992:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2364:x1873925602621056:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787115021.451380:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2364:x1873925602621056:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 Request processed in 390us (622us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787115021.451388:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 50 00000100:00080000:2.0:1787115021.451448:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787115021.458404:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115021.458585:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602621312 00000100:00100000:2.0:1787115021.458595:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602621312 00000100:00100000:2.0:1787115021.458645:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 49 00000100:00100000:2.0:1787115021.458655:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+58:11496:x1873925602621312:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787115021.459056:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+59:11496:x1873925602621312:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 Request processed in 343us (598us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1787115021.459066:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 49 00000100:00100000:0.0:1787115021.467028:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115021.467089:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602621568 00000100:00100000:2.0:1787115021.467099:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602621568 00000100:00100000:2.0:1787115021.467377:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 180 00000100:00100000:2.0:1787115021.467387:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+59:11496:x1873925602621568:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787115021.467496:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+59:11496:x1873925602621568:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 Request processed in 112us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115021.467505:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 180 00000100:00100000:2.0:1787115021.469379:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115021.469879:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602621696 00000100:00100000:1.0:1787115021.469889:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602621696 00000100:00100000:1.0:1787115021.469952:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 181 00000100:00100000:1.0:1787115021.469965:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07fb96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+59:11496:x1873925602621696:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787115021.469996:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115021.470020:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c8f52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d16fc expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.470088:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8f59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.470104:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.470132:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787115021.470170:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787115021.470189:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.470216:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1200/0x194cd781e88c8f52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16fc expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.470231:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8f59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16fc expref: 60 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.470240:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8af051ecb500) 00010000:00010000:1.0:1787115021.470243:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787115021.470246:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0e00, rc 0) 00000100:00100000:1.0:1787115021.470313:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07fb96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+60:11496:x1873925602621696:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 352us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115021.470321:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 181 00000100:00100000:0.0:1787115021.473963:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115021.474065:0:11900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602621824 00000100:00100000:2.0:1787115021.474074:0:11900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602621824 00000100:00100000:2.0:1787115021.474199:0:11900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 51 00000100:00100000:2.0:1787115021.474210:0:11900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2363:x1873925602621824:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787115021.474228:0:11900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115021.474249:0:11900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000072cb646/0x194cd781e88c8f60 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1703 expref: -99 pid: 11900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787115021.474275:0:11900:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a85360e, blocks: 0x1 00010000:00010000:2.0:1787115021.474297:0:11900:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=350s v=(0 0) 00010000:00010000:2.0:1787115021.474301:0:11900:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115021.474310:0:11900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000072cb646/0x194cd781e88c8f60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1703 expref: 8 pid: 11900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.474328:0:11900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000072cb646/0x194cd781e88c8f60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1703 expref: 8 pid: 11900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.474341:0:11900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216e600, rc 0) 00000100:00100000:2.0:1787115021.474406:0:11900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2363:x1873925602621824:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 198us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115021.474412:0:11900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 51 00000100:00100000:3.0:1787115021.477373:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115021.477454:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602622080 00000100:00100000:2.0:1787115021.477465:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602622080 00000100:00100000:2.0:1787115021.477523:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 182 00000100:00100000:2.0:1787115021.477534:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+60:11496:x1873925602622080:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787115021.477657:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+60:11496:x1873925602622080:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 Request processed in 124us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115021.477664:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 182 00000100:00100000:3.0:1787115021.480401:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115021.480570:0:11535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602622208 00000100:00100000:0.0:1787115021.480578:0:11535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602622208 00000100:00100000:0.0:1787115021.480625:0:11535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 52 00000100:00100000:0.0:1787115021.480635:0:11535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:11496:x1873925602622208:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787115021.480654:0:11535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115021.480675:0:11535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8f67 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d170a expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.480703:0:11535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000072cb646/0x194cd781e88c8f60 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1703 expref: 9 pid: 11900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.480716:0:11535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787115021.480720:0:11535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787115021.480723:0:11535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8f67 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d170a expref: 9 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.480750:0:11535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000072cb646/0x194cd781e88c8f60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1703 expref: 9 pid: 11900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.480763:0:11535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000072cb646/0x194cd781e88c8f60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1703 expref: 9 pid: 11900 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115021.480776:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11535:1873925624638336:192.168.202.10@tcp:104: 00000100:00100000:0.0:1787115021.480870:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0438e8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787115021.484172:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115021.484357:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602622336 00000100:00100000:3.0:1787115021.484365:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602622336 00010000:00010000:3.0:1787115021.484401:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000072cb646/0x194cd781e88c8f60 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1703 expref: 10 pid: 11900 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115021.484451:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 67 00000100:00100000:3.0:1787115021.484459:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+10:2363:x1873925602622336:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787115021.484479:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787115021.484499:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000072cb646/0x194cd781e88c8f60 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1703 expref: 10 pid: 11900 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.484509:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000072cb646/0x194cd781e88c8f60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1703 expref: 10 pid: 11900 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.484533:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115021.484536:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115021.484544:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8f67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d170a expref: 10 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.484551:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8f67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d170a expref: 10 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.484587:0:6592:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8f67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d170a expref: 10 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115021.484597:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6592:1873925624638464:192.168.202.10@tcp:105: 00000100:00100000:3.0:1787115021.484673:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f0ede40 going to sleep for 11 seconds 00000100:00100000:3.0:1787115021.489219:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6592:1873925624638464:192.168.202.10@tcp:105: 00010000:00010000:3.0:1787115021.489266:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787115021.489328:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+10:2363:x1873925602622336:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 4867us (5166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115021.489339:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 67 00010000:00010000:2.0:1787115021.490470:0:11535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000072cb646/0x194cd781e88c8f60 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1703 expref: 9 pid: 11900 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115021.490495:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11535:1873925624638336:192.168.202.10@tcp:104: 00010000:00010000:2.0:1787115021.490523:0:11535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8f67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d170a expref: 8 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.490537:0:11535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030a00, rc 0) 00000100:00100000:2.0:1787115021.490637:0:11535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:11496:x1873925602622208:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 10002us (10242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115021.490647:0:11535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 52 00000100:00100000:2.0:1787115021.493861:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115021.494006:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602622464 00000100:00100000:1.0:1787115021.494017:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602622464 00002000:00100000:1.0:1787115021.494071:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8af0739eca80 x1873925602622464/t0(0) o4->6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp:587/0 lens 504/0 e 0 to 0 dl 1787115032 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787115021.494082:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af0739eca80 with x1873925602622464 ext(0->8) 00002000:00010000:1.0:1787115021.494088:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af0739eca80 00000100:00100000:1.0:1787115021.494140:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4 00000100:00100000:1.0:1787115021.494156:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2364:x1873925602622464:12345-192.168.202.10@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787115021.494744:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+10:2364:x1873925602622464:12345-192.168.202.10@tcp:4:lhsmtool_posix.0 Request processed in 588us (890us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787115021.494751:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4 00002000:00100000:1.0:1787115021.494756:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8af0739eca80 x1873925602622464/t4294967314(0) o4->6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp:587/0 lens 504/448 e 0 to 0 dl 1787115032 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787115021.494762:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af0739eca80 with x1873925602622464 ext(0->8) 00002000:00010000:1.0:1787115021.494765:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af0739eca80 00000100:00100000:0.0:1787115021.498730:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115021.500192:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602622592 00000100:00100000:1.0:1787115021.500211:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602622592 00000100:00100000:1.0:1787115021.500291:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 183 00000100:00100000:1.0:1787115021.500301:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+60:11496:x1873925602622592:12345-192.168.202.10@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787115021.532438:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+60:11496:x1873925602622592:12345-192.168.202.10@tcp:44:lhsmtool_posix.0 Request processed in 32128us (33709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115021.532451:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 183 00000001:00080000:1.0:1787115021.532558:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000004:00080000:1.0:1787115021.532590:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787115021.532942:0:5807:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8af06f5fa780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787115021.532954:0:5807:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af06f3ddd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8af06f5fa3c0 00000020:00080000:1.0:1787115021.532957:0:5807:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af06f3dda00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af06f4c2000 00000020:00080000:0.0:1787115021.532990:0:5818:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1787115021.533288:0:5818:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:1.0:1787115021.533522:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1787115021.533528:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000100:00100000:2.0:1787115021.533726:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787115021.533744:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624638592:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787115021.533801:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115021.533903:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624638720:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787115021.533932:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115021.533987:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624638592 00000100:00100000:3.0:1787115021.533995:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624638592 00000100:00100000:3.0:1787115021.534037:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624638720 00000100:00100000:3.0:1787115021.534040:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624638720 00000001:00080000:1.0:1787115021.534044:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000100:00100000:3.0:1787115021.534079:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787115021.534088:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624638592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787115021.534391:0:6576:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787115021.534394:0:6576:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787115022 00002000:00010000:3.0:1787115021.534397:0:6576:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787115021.534399:0:6576:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787115022 -> 1787115022 00002000:00010000:3.0:1787115021.534401:0:6576:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787115021.534442:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1873925624638592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 355us (640us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787115021.534449:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787115021.534535:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787115021.534545:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624638720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787115021.534561:0:6576:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1787115021.534586:0:6576:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a85360b, atime: 0x6a85360c, ctime: 0x6a85360b, blocks: 0xb 00010000:00010000:3.0:1787115021.534593:0:6576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5f2c439/0x194cd781e88c8f6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.534679:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=350s v=(0 0) 00010000:00010000:3.0:1787115021.534685:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115021.534704:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5f2c439/0x194cd781e88c8f6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.534720:0:6576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5f2c439/0x194cd781e88c8f6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.534731:0:6576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5f2c439/0x194cd781e88c8f6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.534739:0:6576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5f2c439/0x194cd781e88c8f6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.534758:0:6576:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787115021.535278:0:8290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787115021.535288:0:8290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5f2c439/0x194cd781e88c8f6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.535298:0:8290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682200 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:1.0:1787115021.535302:0:8290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5f2c439/0x194cd781e88c8f6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.535312:0:8290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5f2c439/0x194cd781e88c8f6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.535333:0:8290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5f2c439/0x194cd781e88c8f6e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.535340:0:8290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5f2c439/0x194cd781e88c8f6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.535358:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115021.535360:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115021.535361:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787115021.536636:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787115021.536693:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8af0739ec380/2, rc 0, transno 4294967315 00000100:00100000:0.0:1787115021.536705:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624638592:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787115021.536755:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1873925624638720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2211us (2821us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787115021.536765:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787115021.537220:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115021.537279:0:11535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602622720 00000100:00100000:0.0:1787115021.537287:0:11535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602622720 00000100:00100000:0.0:1787115021.537338:0:11535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 55 00000100:00100000:0.0:1787115021.537346:0:11535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c15b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+10:2364:x1873925602622720:12345-192.168.202.10@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787115021.539401:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1787115021.539415:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1787115021.540463:0:3306:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8af07f7e5180 x1873925624638720/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787115037 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787115021.540546:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8af07f7e5180/2, rc 0, transno 4294967307 00000100:00100000:2.0:1787115021.540552:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624638720:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1787115021.568807:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:2.0:1787115021.568845:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1787115021.568975:0:11535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c15b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2364:x1873925602622720:12345-192.168.202.10@tcp:16:lhsmtool_posix.0 Request processed in 31623us (31752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115021.568986:0:11535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 55 00000100:00100000:2.0:1787115021.572609:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115021.572673:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602622976 00000100:00100000:0.0:1787115021.572686:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602622976 00000100:00100000:0.0:1787115021.572747:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 184 00000100:00100000:0.0:1787115021.572758:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:11496:x1873925602622976:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787115021.572824:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787115021.572868:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c8f59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16fc expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.572887:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8af051ecb500) 00010000:00010000:0.0:1787115021.572892:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787115021.572923:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8f75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.572941:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8f75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.572951:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8f75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787115021.573568:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000afce0cd4 reply state 000000009e9021bc transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8f75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115021.573774:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787115021.573939:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+19:11496:x1873925602622976:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 Request processed in 1182us (1339us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1787115021.573948:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 184 00000100:00100000:0.0:1787115021.578218:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115021.578313:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602623104 00000100:00100000:3.0:1787115021.578324:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602623104 00010000:00010000:2.0:1787115021.578335:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8f75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.578348:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8f75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.578355:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8f75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.578363:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040031600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115021.578368:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8f75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.578376:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8f75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.578394:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8af051ecb500) 00010000:00010000:2.0:1787115021.578397:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115021.578403:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8f75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.578409:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8f75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115021.578932:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 56 00000100:00100000:3.0:1787115021.578941:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2363:x1873925602623104:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787115021.579437:0:6577:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787115021.579440:0:6577:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787115022 -> 1787115021 00002000:00010000:3.0:1787115021.579442:0:6577:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787115020 00002000:00010000:3.0:1787115021.579444:0:6577:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787115022 -> 1787115021 00002000:00010000:3.0:1787115021.579458:0:6577:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787115021.579526:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2363:x1873925602623104:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 Request processed in 585us (1319us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787115021.579533:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 56 00000100:00100000:0.0:1787115021.581645:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115021.581695:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602623360 00000100:00100000:2.0:1787115021.581705:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602623360 00000100:00100000:2.0:1787115021.581764:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 185 00000100:00100000:2.0:1787115021.581775:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:11496:x1873925602623360:12345-192.168.202.10@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787115021.581861:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8f7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.581973:0:7216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8f3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16ee expref: 18 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.581980:0:7216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8f7c lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.582014:0:7216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8f3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16ee expref: 18 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.582028:0:7216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8f3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16ee expref: 18 pid: 7216 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115021.582044:0:7216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7216:1873925624638848:192.168.202.10@tcp:104: 00000100:00100000:2.0:1787115021.582161:0:7216:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af05470f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787115021.584176:0:7216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7216:1873925624638848:192.168.202.10@tcp:104: 00010000:00010000:0.0:1787115021.584232:0:7216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8f7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115021.584700:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115021.584779:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602623488 00000100:00100000:3.0:1787115021.584786:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602623488 00010000:00010000:3.0:1787115021.584821:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8f3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16ee expref: 19 pid: 7216 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115021.584865:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 68 00000100:00100000:3.0:1787115021.584874:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+19:2364:x1873925602623488:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787115021.584893:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787115021.584900:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8f3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16ee expref: 19 pid: 7216 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.584911:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8f3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16ee expref: 19 pid: 7216 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.584937:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8f3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16ee expref: 19 pid: 7216 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.584954:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8af051ecb500) 00010000:00010000:3.0:1787115021.584959:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8f7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.584968:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8f7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.584983:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8f7c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.585011:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787115021.585057:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:2364:x1873925602623488:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 185us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115021.585063:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 68 00010000:00010000:0.0:1787115021.585498:0:7216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8f7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.585508:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8f7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.585539:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8f7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.585546:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8f7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.585553:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8f7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.585559:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216f200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115021.585562:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8f7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.585567:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8f7c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.585574:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8af051ecb500) 00010000:00010000:0.0:1787115021.585576:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787115021.585579:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8f7c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.585583:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8f7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115021.585645:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+17:11496:x1873925602623360:12345-192.168.202.10@tcp:55:lhsmtool_posix.0 Request processed in 3870us (4051us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787115021.585653:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 185 00000100:00100000:0.0:1787115021.587466:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115021.587549:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602623616 00000100:00100000:1.0:1787115021.587568:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602623616 00000100:00100000:1.0:1787115021.587613:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 57 00000100:00100000:1.0:1787115021.587622:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2363:x1873925602623616:12345-192.168.202.10@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787115021.587669:0:6578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c8f83 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.587690:0:6578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8f67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d170a expref: 8 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.587698:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787115021.587703:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787115021.587707:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c8f83 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.587740:0:6578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8f67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d170a expref: 8 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.587752:0:6578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8f67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d170a expref: 8 pid: 11535 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115021.587768:0:6578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06c159880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6578:1873925624638976:192.168.202.10@tcp:104: 00000100:00100000:1.0:1787115021.587856:0:6578:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050797b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787115021.590614:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115021.590669:0:6578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06c159880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6578:1873925624638976:192.168.202.10@tcp:104: 00010000:00010000:1.0:1787115021.590698:0:6578:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c8f83 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115021.590850:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602623744 00000100:00100000:0.0:1787115021.590857:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602623744 00010000:00010000:0.0:1787115021.590905:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8f67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d170a expref: 9 pid: 11535 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115021.590946:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 69 00000100:00100000:0.0:1787115021.590955:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:2364:x1873925602623744:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787115021.590969:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787115021.591171:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8f67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d170a expref: 9 pid: 11535 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.591184:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8f67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d170a expref: 9 pid: 11535 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.591207:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c8f67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d170a expref: 9 pid: 11535 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.591223:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787115021.591228:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787115021.591233:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c8f83 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.591258:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c8f83 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.591279:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787115021.591305:0:6578:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c8f83 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.591313:0:6578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c8f83 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.591338:0:6578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c8f83 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115021.591338:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2364:x1873925602623744:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 384us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115021.591346:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 69 00010000:00010000:1.0:1787115021.591348:0:6578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c8f83 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.591355:0:6578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c8f83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.591363:0:6578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1c00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:1.0:1787115021.591367:0:6578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c8f83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.591377:0:6578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c8f83 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.591390:0:6578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c8f83 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.591409:0:6578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c8f83 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115021.591458:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2363:x1873925602623616:12345-192.168.202.10@tcp:1:lhsmtool_posix.0 Request processed in 3837us (3998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115021.591467:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 57 00000100:00100000:0.0:1787115021.594044:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115021.594098:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602624000 00000100:00100000:2.0:1787115021.594377:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602624000 00000100:00100000:2.0:1787115021.594453:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 186 00000100:00100000:2.0:1787115021.594463:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+17:11496:x1873925602624000:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787115021.594566:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8f8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.594586:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8f8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.594599:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8f8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.594863:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f91 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.594883:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c8f4b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16f5 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.594891:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f91 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.594928:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c8f4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16f5 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.594944:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c8f4b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16f5 expref: 18 pid: 5786 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115021.594959:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624639104:192.168.202.10@tcp:104: 00000100:00100000:2.0:1787115021.595047:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af05470fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787115021.597952:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624639104:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787115021.597989:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f91 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115021.598134:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115021.598425:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602624128 00000100:00100000:2.0:1787115021.598433:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602624128 00010000:00010000:2.0:1787115021.598471:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c8f4b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16f5 expref: 19 pid: 5786 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115021.598516:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 70 00000100:00100000:2.0:1787115021.598525:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c159880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+19:2364:x1873925602624128:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115021.598543:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115021.598550:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c8f4b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16f5 expref: 19 pid: 5786 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.598576:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c8f4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16f5 expref: 19 pid: 5786 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.598598:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c8f4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16f5 expref: 19 pid: 5786 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.598619:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8af051ecb500) 00010000:00010000:2.0:1787115021.598624:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f91 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.598633:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.598641:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f91 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.598670:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115021.598719:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c159880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:2364:x1873925602624128:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 195us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115021.598727:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 70 00010000:00010000:1.0:1787115021.599489:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.599498:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787115021.599673:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1787115021.599816:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1787115021.599871:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1787115021.599956:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5787:1873925624639232:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787115021.600008:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115021.600045:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050797480 going to sleep for 11 seconds 00000100:00100000:0.0:1787115021.600662:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624639232 00000100:00100000:0.0:1787115021.600671:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624639232 00000100:00100000:0.0:1787115021.600727:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787115021.600736:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5787:x1873925624639232:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787115021.600822:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5787:x1873925624639232:12345-0@lo:1000:mdt00_002.0 Request processed in 87us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115021.600842:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787115021.601520:0:5787:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1787115021.601529:0:5787:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8af0739ec380, transno 4294967315 00000100:00100000:1.0:1787115021.601552:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5787:1873925624639232:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787115021.602066:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1787115021.602203:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5787:1873925624639360:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787115021.603012:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115021.603088:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050797b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787115021.603780:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624639360 00000100:00100000:0.0:1787115021.603791:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624639360 00000100:00100000:2.0:1787115021.603883:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787115021.603893:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5787:x1873925624639360:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787115021.604300:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5787:x1873925624639360:12345-0@lo:1000:mdt00_002.0 Request processed in 407us (1288us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787115021.604308:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787115021.605265:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5787:1873925624639360:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787115021.605315:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.605328:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f91 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.605337:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f91 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.605345:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115021.605350:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f91 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.605358:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f91 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.605378:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8af051ecb500) 00010000:00010000:1.0:1787115021.605387:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787115021.605392:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f91 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.605398:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8f91 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.605430:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8ec6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.605438:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8ec6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.605445:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8ec6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.605457:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115021.605460:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8ec6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.605467:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8ec6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.605476:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0514c6e00) 00010000:00010000:1.0:1787115021.605479:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787115021.605482:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8ec6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.605488:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8ec6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.605514:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8f98 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.605528:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ee2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16d9 expref: 21 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.605537:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8f98 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.605573:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ee2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16d9 expref: 21 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.605590:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ee2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16d9 expref: 21 pid: 5785 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115021.605631:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624639488:192.168.202.10@tcp:104: 00000100:00100000:1.0:1787115021.605718:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050797b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787115021.610133:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115021.610200:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624639488:192.168.202.10@tcp:104: 00010000:00010000:1.0:1787115021.610243:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8f98 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115021.610484:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602624256 00000100:00100000:3.0:1787115021.610490:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602624256 00010000:00010000:3.0:1787115021.610530:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ee2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16d9 expref: 22 pid: 5785 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115021.610576:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 71 00000100:00100000:3.0:1787115021.610586:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+22:2363:x1873925602624256:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787115021.610602:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787115021.610610:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ee2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16d9 expref: 22 pid: 5785 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.610622:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ee2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16d9 expref: 22 pid: 5785 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.610644:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ee2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d16d9 expref: 22 pid: 5785 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.610674:0:6592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0514c6e00) 00010000:00010000:3.0:1787115021.610679:0:6592:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8f98 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.610689:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8f98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.610698:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8f98 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.610722:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787115021.610781:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+21:2363:x1873925602624256:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 196us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115021.610790:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 71 00010000:00010000:3.0:1787115021.610814:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8f98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.610822:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8f98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.610845:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8f98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.610853:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8f98 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.610860:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8f98 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.610867:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115021.610878:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8f98 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.610887:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8f98 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.610897:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0514c6e00) 00010000:00010000:3.0:1787115021.610900:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115021.610904:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8f98 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.610910:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c8f98 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.610922:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8f8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.610928:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8f8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.610935:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8f8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.610940:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216f800 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115021.610942:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8f8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.610948:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8f8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.610956:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0514c6e00) 00010000:00010000:3.0:1787115021.610958:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787115021.610967:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8f8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115021.610973:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8f8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787115021.611731:0:11519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787115021.611737:0:11519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1787115021.612345:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+20:11496:x1873925602624000:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 Request processed in 17878us (18309us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787115021.612358:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 186 00000020:00080000:3.0:1787115021.612364:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787115021.612822:0:11519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787115021.612839:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787115021.616423:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115021.616468:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602624512 00000100:00100000:0.0:1787115021.616478:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602624512 00000100:00100000:0.0:1787115021.616584:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 50 00000100:00100000:0.0:1787115021.616596:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06634a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+20:11496:x1873925602624512:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787115021.617403:0:5788:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787115021.617505:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1787115021.617556:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8f9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.617586:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8f9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.617601:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8f9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.617611:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8f9f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.617617:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8f9f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.617624:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8f9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.617654:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787115021.617758:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06634a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+22:11496:x1873925602624512:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 Request processed in 1162us (1341us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1787115021.617769:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 50 00000020:00080000:0.0:1787115021.617774:0:5788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787115021.617865:0:8291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787115021.617872:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8f9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.617880:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030a00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:1.0:1787115021.617883:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8f9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.617892:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8f9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.617906:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8af051ecbb00) 00010000:00010000:1.0:1787115021.617910:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787115021.617915:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8f9f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.617920:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8f9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115021.617939:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115021.617947:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115021.617949:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115021.637932:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787115021.724792:0:12295:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787115021.724805:0:12295:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787115021.724866:0:12295:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787115021.724875:0:12295:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787115021.880377:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115021.880416:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602624768 00000100:00100000:2.0:1787115021.880425:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602624768 00000100:00100000:2.0:1787115021.880853:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 187 00000100:00100000:2.0:1787115021.880865:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+22:11506:x1873925602624768:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1787115021.880892:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115021.880916:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8fa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1711 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.882454:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8fad lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.882597:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8fad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.882609:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8fad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115021.882624:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787115021.882796:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f200/0x194cd781e88c8fa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1711 expref: 25 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.882814:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8fad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1711 expref: 24 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.882823:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:2.0:1787115021.882837:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787115021.882848:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216f800, rc 0) 00000100:00100000:2.0:1787115021.882918:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+24:11506:x1873925602624768:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 2055us (2550us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1787115021.882926:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 187 00000100:00100000:2.0:1787115021.889322:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115021.889357:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602624896 00000100:00100000:2.0:1787115021.889366:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602624896 00000100:00100000:2.0:1787115021.889410:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 188 00000100:00100000:2.0:1787115021.889418:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+24:11506:x1873925602624896:12345-192.168.202.10@tcp:34:lfs.0 00010000:00010000:2.0:1787115021.889593:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8fbb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.889609:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8fbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.889622:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8fbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.889635:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8fc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.889642:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.889649:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.889922:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8fc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.889930:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.889942:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787115021.889976:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.889988:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8fbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.889995:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8fbb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.890001:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8fbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.890007:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115021.890011:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8fbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.890018:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8fbb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.890030:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:2.0:1787115021.890033:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115021.890037:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8fbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.890044:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e200/0x194cd781e88c8fbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.890056:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.890067:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8fc2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.890073:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8fc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.890077:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115021.890080:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8fc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.890086:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8fc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.890093:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8af0514c6300) 00010000:00010000:2.0:1787115021.890095:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115021.890097:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8fc2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.890102:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c8fc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.890137:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.891559:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8fc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.891567:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.891573:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e800 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115021.891584:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.891592:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8fc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.891605:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af0514c6600) 00010000:00010000:2.0:1787115021.891608:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115021.891611:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8fc9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115021.891618:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e800/0x194cd781e88c8fc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115021.891712:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+24:11506:x1873925602624896:12345-192.168.202.10@tcp:34:lfs.0 Request processed in 2291us (2396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115021.891722:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 188 00000100:00100000:1.0:1787115021.994314:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115021.994727:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602625152 00000100:00100000:0.0:1787115021.994742:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602625152 00000100:00100000:0.0:1787115021.994814:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 189 00000100:00100000:0.0:1787115021.994836:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+24:11509:x1873925602625152:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1787115021.994858:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115021.994884:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8fd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1718 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.994958:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8fd7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.994986:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8fd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.994998:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8fd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995013:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8fde lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995020:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8fde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995027:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8fde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995519:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8fe5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995527:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995535:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115021.995544:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787115021.995629:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8fd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995636:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8fd7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995643:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8fd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995655:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115021.995659:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8fd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995667:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8fd7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995678:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:0.0:1787115021.995681:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115021.995686:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8fd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995690:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c8fd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995703:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8fde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995708:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8fde lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995712:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8fde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995718:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040031600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115021.995720:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8fde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995726:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8fde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995743:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8af051ecbe00) 00010000:00010000:0.0:1787115021.995745:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115021.995748:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8fde lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995754:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c8fde lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995793:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8fd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1718 expref: 27 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995807:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1718 expref: 26 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115021.995814:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af051ecbf00) 00010000:00010000:0.0:1787115021.995817:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787115021.995819:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030200, rc 0) 00000100:00100000:0.0:1787115021.995917:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+26:11509:x1873925602625152:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1093us (1619us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1787115021.995926:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 189 00000100:00100000:2.0:1787115022.006434:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115022.006580:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602625280 00000100:00100000:3.0:1787115022.006596:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602625280 00000100:00080000:0.0:1787115022.006845:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787115022.006870:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 190 00000100:00100000:3.0:1787115022.007025:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+26:11509:x1873925602625280:12345-192.168.202.10@tcp:54:lfs.0 00010000:00010000:3.0:1787115022.007168:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ff3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.007190:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.007206:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.007247:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.007746:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ff3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.007753:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.007760:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115022.007765:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.007772:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ff3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.007786:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af051ecbf00) 00010000:00010000:3.0:1787115022.007788:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787115022.007795:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ff3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.007801:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c8ff3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115022.007929:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+26:11509:x1873925602625280:12345-192.168.202.10@tcp:54:lfs.0 Request processed in 1047us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115022.007938:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 190 00000100:00100000:1.0:1787115022.011737:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115022.012218:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602625536 00000100:00100000:3.0:1787115022.012229:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602625536 00000100:00100000:3.0:1787115022.012291:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 51 00000100:00100000:3.0:1787115022.012301:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+26:11509:x1873925602625536:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:3.0:1787115022.012577:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+27:11509:x1873925602625536:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 277us (849us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787115022.012600:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 51 00000100:00100000:1.0:1787115022.082731:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115022.082880:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602625792 00000100:00100000:0.0:1787115022.082895:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602625792 00000100:00100000:0.0:1787115022.083030:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 191 00000100:00100000:0.0:1787115022.083041:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+27:11043:x1873925602625792:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:0.0:1787115022.083073:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115022.083099:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8ffa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d171f expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.083297:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9001 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.083316:0:7216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8fe5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1718 expref: 28 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.083326:0:7216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9001 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.083371:0:7216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1718 expref: 28 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.083387:0:7216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8fe5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1718 expref: 28 pid: 7216 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115022.083406:0:7216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af05125df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7216:1873925624639616:192.168.202.10@tcp:104: 00000100:00100000:0.0:1787115022.083522:0:7216:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045be1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787115022.087772:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115022.087873:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602625920 00000100:00100000:2.0:1787115022.087885:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602625920 00010000:00010000:2.0:1787115022.087934:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8fe5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1718 expref: 29 pid: 7216 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115022.088014:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 72 00000100:00100000:2.0:1787115022.088023:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b472300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+29:2363:x1873925602625920:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115022.088049:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115022.088056:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8fe5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1718 expref: 29 pid: 7216 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.088068:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8fe5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1718 expref: 29 pid: 7216 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.088139:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af051ecbf00) 00010000:00010000:2.0:1787115022.088144:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9001 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.088152:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9001 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.088157:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9001 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.088177:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115022.088236:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b472300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+29:2363:x1873925602625920:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 213us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115022.088243:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 72 00010000:00010000:0.0:1787115022.088688:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c8fe5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1718 expref: 28 pid: 7216 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115022.088709:0:7216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af05125df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7216:1873925624639616:192.168.202.10@tcp:104: 00010000:00010000:0.0:1787115022.088737:0:7216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9001 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.088745:0:7216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9001 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.088759:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9001 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115022.088779:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787115022.088993:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c8ffa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d171f expref: 29 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.089010:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9001 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d171f expref: 28 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.089019:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af051ecbf00) 00010000:00010000:0.0:1787115022.089022:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787115022.089037:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040031600, rc 0) 00000100:00100000:0.0:1787115022.089072:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+28:11043:x1873925602625792:12345-192.168.202.10@tcp:101:bash.0 Request processed in 6033us (6357us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787115022.089080:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 191 00000100:00100000:0.0:1787115022.092885:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115022.092970:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602626176 00000100:00100000:2.0:1787115022.092981:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602626176 00000100:00100000:2.0:1787115022.093223:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 192 00000100:00100000:2.0:1787115022.093236:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+28:11043:x1873925602626176:12345-192.168.202.10@tcp:36:bash.0 00010000:00010000:2.0:1787115022.093735:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c900f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.093756:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c900f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.093769:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c900f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787115022.093863:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1787115022.093895:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000899b05fd reply state 0000000041b3b32e transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c900f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115022.093924:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787115022.093969:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1787115022.094527:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+32:11043:x1873925602626176:12345-192.168.202.10@tcp:36:bash.0 Request processed in 1288us (1653us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787115022.094537:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 192 00000020:00080000:2.0:1787115022.094545:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787115022.098591:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115022.099268:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602626304 00000100:00100000:2.0:1787115022.099287:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602626304 00000100:00100000:2.0:1787115022.099376:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 193 00000100:00100000:2.0:1787115022.099389:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+32:11043:x1873925602626304:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:2.0:1787115022.099428:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115022.099459:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c9016 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1726 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.099553:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c9016 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1726 expref: 33 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.099572:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c9016 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1726 expref: 33 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.099598:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af051ecbf00) 00010000:00010000:2.0:1787115022.099612:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787115022.099617:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3c00, rc 0) 00000100:00100000:2.0:1787115022.099926:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+33:11043:x1873925602626304:12345-192.168.202.10@tcp:101:bash.0 Request processed in 538us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115022.099934:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 193 00000100:00100000:3.0:1787115022.104341:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1787115022.104556:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c900f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.104573:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c900f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.104581:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c900f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.104589:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115022.104595:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c900f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.104637:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c900f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.104659:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af051ecbf00) 00010000:00010000:0.0:1787115022.104662:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115022.104668:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c900f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.104675:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c900f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115022.104901:0:11535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602626432 00000100:00100000:2.0:1787115022.104915:0:11535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602626432 00000100:00100000:2.0:1787115022.104998:0:11535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 58 00000100:00100000:2.0:1787115022.105009:0:11535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:11043:x1873925602626432:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:2.0:1787115022.105032:0:11535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115022.105058:0:11535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061e725fe/0x194cd781e88c901d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d172d expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787115022.105090:0:11535:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a85360d, atime: 0x6a85360c, ctime: 0x6a85360d, blocks: 0xb 00010000:00010000:2.0:1787115022.105148:0:11535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=351s v=(0 0) 00010000:00010000:2.0:1787115022.105153:0:11535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115022.105162:0:11535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061e725fe/0x194cd781e88c901d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d172d expref: 8 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.105183:0:11535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061e725fe/0x194cd781e88c901d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d172d expref: 8 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.105197:0:11535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3a00, rc 0) 00000100:00100000:2.0:1787115022.105273:0:11535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:11043:x1873925602626432:12345-192.168.202.10@tcp:101:bash.0 Request processed in 266us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115022.105281:0:11535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 58 00000100:00100000:3.0:1787115022.108012:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115022.108176:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602626560 00000100:00100000:1.0:1787115022.108189:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602626560 00002000:00010000:1.0:1787115022.108245:0:6584:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1787115022.108251:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af07f7e7480 with x1873925602626560 ext(0->18446744073709551615) 00002000:00010000:1.0:1787115022.108265:0:6584:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af07f7e7480. 00000100:00100000:1.0:1787115022.108301:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5 00000100:00100000:1.0:1787115022.108312:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2364:x1873925602626560:12345-192.168.202.10@tcp:10:bash.0 00002000:00010000:1.0:1787115022.108726:0:6584:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787115022.108731:0:6584:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787115021 -> 1787115022 00002000:00010000:1.0:1787115022.108733:0:6584:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787115020 -> 1787115020 00002000:00010000:1.0:1787115022.108736:0:6584:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787115021 -> 1787115022 00002000:00010000:1.0:1787115022.108739:0:6584:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787115022.108814:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:2364:x1873925602626560:12345-192.168.202.10@tcp:10:bash.0 Request processed in 502us (825us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787115022.108836:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5 00002000:00010000:1.0:1787115022.108841:0:6584:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1787115022.108845:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af07f7e7480 with x1873925602626560 ext(0->18446744073709551615) 00002000:00010000:1.0:1787115022.108850:0:6584:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af07f7e7480. 00000100:00100000:1.0:1787115022.196446:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115022.196555:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602626688 00000100:00100000:3.0:1787115022.196569:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602626688 00000100:00100000:3.0:1787115022.196647:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 194 00000100:00100000:3.0:1787115022.196658:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+32:11523:x1873925602626688:12345-192.168.202.10@tcp:34:lfs.0 00010000:00010000:3.0:1787115022.196789:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9024 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.196809:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9024 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.196833:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9024 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.196852:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c902b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.196859:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c902b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.196866:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c902b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197301:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9032 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197313:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9032 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197334:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9032 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787115022.197392:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9032 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197407:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9024 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197416:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9024 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197423:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9024 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197430:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115022.197436:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9024 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197443:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9024 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197457:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:3.0:1787115022.197461:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115022.197466:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9024 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197473:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9024 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197488:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c902b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197501:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c902b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197507:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c902b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197512:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115022.197516:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c902b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197522:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c902b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197531:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8af044d99700) 00010000:00010000:3.0:1787115022.197534:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115022.197537:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c902b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197544:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c902b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197561:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9032 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197568:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9032 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197574:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9032 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197579:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115022.197586:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9032 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197593:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9032 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197600:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af051ecbf00) 00010000:00010000:3.0:1787115022.197601:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115022.197604:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9032 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.197610:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9032 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115022.197716:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+32:11523:x1873925602626688:12345-192.168.202.10@tcp:34:lfs.0 Request processed in 1057us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115022.197726:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 194 00000100:00100000:2.0:1787115022.241249:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115022.241425:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602626944 00000100:00100000:1.0:1787115022.241453:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602626944 00000100:00100000:1.0:1787115022.241514:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 195 00000100:00100000:1.0:1787115022.241524:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+32:11526:x1873925602626944:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1787115022.241548:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115022.241573:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9039 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1734 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.241675:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9040 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.241689:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9040 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.241701:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9040 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.241712:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c9047 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.241717:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c9047 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.241721:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c9047 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.242062:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c904e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.242070:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c904e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.242074:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c904e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787115022.242088:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787115022.242255:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9040 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.242263:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9040 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.242269:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9040 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.242276:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1a00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115022.242281:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9040 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.242290:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9040 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.242305:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:1.0:1787115022.242309:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787115022.242314:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9040 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.242320:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9040 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.242333:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c9047 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.242341:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c9047 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.242358:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c9047 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.242364:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115022.242367:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c9047 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.242374:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c9047 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.242382:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8af0510d6200) 00010000:00010000:1.0:1787115022.242384:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787115022.242387:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c9047 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.242392:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c9047 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.242443:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9039 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1734 expref: 35 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.242457:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c904e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1734 expref: 34 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.242464:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af051ecbf00) 00010000:00010000:1.0:1787115022.242466:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787115022.242469:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0e00, rc 0) 00000100:00100000:1.0:1787115022.242551:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+34:11526:x1873925602626944:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1028us (1319us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1787115022.242564:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 195 00000100:00100000:0.0:1787115022.245561:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115022.245659:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602627072 00000100:00100000:2.0:1787115022.245675:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602627072 00000100:00100000:2.0:1787115022.245776:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 196 00000100:00100000:2.0:1787115022.245785:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+34:11526:x1873925602627072:12345-192.168.202.10@tcp:54:lfs.0 00010000:00010000:2.0:1787115022.245902:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c905c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.245917:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9001 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d171f expref: 34 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.245925:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c905c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.245961:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9001 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d171f expref: 34 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.245974:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9001 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d171f expref: 34 pid: 7216 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115022.245987:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624639744:192.168.202.10@tcp:104: 00000100:00100000:2.0:1787115022.246138:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af05470f540 going to sleep for 11 seconds 00000100:00100000:3.0:1787115022.249274:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115022.249753:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602627328 00000100:00100000:0.0:1787115022.249763:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602627328 00000100:00100000:0.0:1787115022.249845:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 52 00000100:00100000:0.0:1787115022.249857:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+35:5577:x1873925602627328:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787115022.249938:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624639744:192.168.202.10@tcp:104: 00010000:00010000:2.0:1787115022.249969:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c905c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115022.250246:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+36:5577:x1873925602627328:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 390us (980us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1787115022.250254:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 52 00000100:00100000:1.0:1787115022.256553:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115022.256684:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602627456 00000100:00100000:3.0:1787115022.256695:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602627456 00010000:00010000:3.0:1787115022.256742:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9001 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d171f expref: 36 pid: 7216 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115022.256972:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 73 00000100:00100000:3.0:1787115022.256983:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b473b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+36:2364:x1873925602627456:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787115022.257000:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787115022.257007:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9001 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d171f expref: 36 pid: 7216 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.257019:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9001 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d171f expref: 36 pid: 7216 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.257061:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9001 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d171f expref: 36 pid: 7216 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.257078:0:6592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af051ecbf00) 00010000:00010000:3.0:1787115022.257083:0:6592:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c905c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.257091:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c905c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.257097:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c905c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.257176:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787115022.257242:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b473b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+35:2364:x1873925602627456:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 261us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115022.257250:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 73 00010000:00010000:0.0:1787115022.257341:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c905c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.257352:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c905c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.257393:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c905c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.257402:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c905c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.257416:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c905c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.257422:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115022.257426:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c905c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.257432:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c905c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.257439:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af051ecbf00) 00010000:00010000:0.0:1787115022.257441:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787115022.257444:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c905c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.257448:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c905c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115022.257483:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+34:11526:x1873925602627072:12345-192.168.202.10@tcp:54:lfs.0 Request processed in 11700us (11933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115022.257489:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 196 00000100:00100000:2.0:1787115022.264544:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115022.264696:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602627712 00000100:00100000:0.0:1787115022.264707:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602627712 00000100:00100000:0.0:1787115022.264781:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 53 00000100:00100000:0.0:1787115022.264801:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+34:11526:x1873925602627712:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:0.0:1787115022.265353:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+35:11526:x1873925602627712:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 553us (818us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1787115022.265362:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 53 00000100:00100000:2.0:1787115022.401210:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115022.401338:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602627968 00000100:00100000:1.0:1787115022.401351:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602627968 00000100:00100000:1.0:1787115022.401421:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 197 00000100:00100000:1.0:1787115022.401432:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+35:11537:x1873925602627968:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:1.0:1787115022.401462:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115022.401487:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9063 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d173b expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.401595:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c906a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.401613:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c906a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.401628:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c906a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.401646:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9071 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.401653:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.401660:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.402068:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c9078 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.402084:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c9078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.402091:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c9078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787115022.402101:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1787115022.402240:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c906a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.402249:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c906a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.402256:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c906a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.402264:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115022.402269:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c906a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.402277:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c906a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.402289:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:1.0:1787115022.402293:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787115022.402297:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c906a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.402303:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c906a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.402315:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.402327:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9071 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.402334:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9071 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.402339:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1a00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115022.402342:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9071 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.402348:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9071 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.402357:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8af0510d6200) 00010000:00010000:1.0:1787115022.402360:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787115022.402363:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9071 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.402369:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9071 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.402412:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9063 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d173b expref: 38 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.402426:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c9078 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d173b expref: 37 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.402434:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af051ecbf00) 00010000:00010000:1.0:1787115022.402437:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787115022.402444:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a1800, rc 0) 00000100:00100000:1.0:1787115022.402522:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+37:11537:x1873925602627968:12345-192.168.202.10@tcp:101:cat.0 Request processed in 1092us (1327us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1787115022.402531:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 197 00000100:00100000:2.0:1787115022.415517:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115022.415740:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602628224 00000100:00100000:0.0:1787115022.415752:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602628224 00000100:00100000:0.0:1787115022.415830:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 54 00000100:00100000:0.0:1787115022.415842:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+37:11537:x1873925602628224:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:0.0:1787115022.416088:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+38:11537:x1873925602628224:12345-192.168.202.10@tcp:35:cat.0 Request processed in 248us (590us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1787115022.416096:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 54 00000100:00100000:0.0:1787115022.478951:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115022.479067:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602628480 00000100:00100000:3.0:1787115022.479079:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602628480 00000100:00100000:3.0:1787115022.479178:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 198 00000100:00100000:3.0:1787115022.479194:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+38:11538:x1873925602628480:12345-192.168.202.10@tcp:36:rm.0 00010000:00010000:3.0:1787115022.479271:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787115022.479306:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c9078 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d173b expref: 38 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.479329:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c904e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1734 expref: 37 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.479364:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c9016 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1726 expref: 36 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.479375:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af051ecbf00) 00010000:00010000:3.0:1787115022.479387:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787115022.479409:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9086 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.479422:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9086 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.479432:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9086 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.479447:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c908d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.479455:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c908d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.479462:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c908d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.484759:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9094 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.484782:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9094 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.484793:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9094 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787115022.485471:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1787115022.485483:0:5785:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351471374542ns, next at 352471372077ns, rc = 0 00010000:00010000:3.0:1787115022.485548:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c909b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.485558:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c909b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.485567:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c909b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.485576:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c909b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.485582:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c909b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.485589:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c909b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.485621:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787115022.485647:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9094 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.485653:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9094 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.485659:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9094 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.485665:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115022.485675:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9094 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.485683:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9094 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.485696:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af044d99900) 00010000:00010000:3.0:1787115022.485699:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787115022.485704:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9094 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.485709:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9094 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.485726:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9086 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.485733:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9086 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.485739:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9086 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.485744:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115022.485747:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9086 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.485752:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9086 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.485759:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:3.0:1787115022.485761:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115022.485770:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9086 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.485775:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9086 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787115022.485785:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003f4b2dae reply state 000000003abee9f2 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c908d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115022.485794:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787115022.485914:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+37:11538:x1873925602628480:12345-192.168.202.10@tcp:36:rm.0 Request processed in 6721us (6971us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1787115022.485923:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 198 00010000:00010000:1.0:1787115022.487751:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787115022.487765:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c909b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.487778:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682200 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:1.0:1787115022.487781:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c909b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.487791:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c909b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.487811:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8af044d99900) 00010000:00010000:1.0:1787115022.487814:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787115022.487828:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c909b lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.487835:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c909b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.487865:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115022.487867:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115022.487869:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115022.492966:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c908d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.492984:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c908d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.492991:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c908d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.492997:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115022.493002:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c908d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.493009:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c908d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.493025:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8af044d99700) 00010000:00010000:3.0:1787115022.493028:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115022.493032:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c908d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.493053:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c908d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115022.576602:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115022.576764:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602628736 00000100:00100000:1.0:1787115022.576775:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602628736 00000100:00100000:1.0:1787115022.576857:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 199 00000100:00100000:1.0:1787115022.576868:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+36:11544:x1873925602628736:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:1.0:1787115022.576893:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115022.576927:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c90a2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1742 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.577064:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c90a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.577078:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c90a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.577089:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c90a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.577102:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c90b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.577161:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c90b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.577168:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c90b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787115022.577942:0:7216:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1787115022.578136:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c90b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.578148:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c90b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.578156:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c90b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.578188:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c90a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.578207:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c90a9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.578212:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c90a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.578218:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1a00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115022.578222:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c90a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.578958:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c90a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.578978:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:1.0:1787115022.578989:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787115022.578995:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c90a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.579001:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c90a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787115022.579015:0:7216:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b57dd9de reply state 000000003d6af71b transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c90b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115022.579025:0:7216:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787115022.579063:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c90a2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1742 expref: 39 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.579078:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c90b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1742 expref: 38 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.579100:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af0510d6300) 00010000:00010000:1.0:1787115022.579103:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787115022.579218:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0200, rc 0) 00000100:00100000:1.0:1787115022.580764:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+39:11544:x1873925602628736:12345-192.168.202.10@tcp:101:bash.0 Request processed in 3890us (4163us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1787115022.580776:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 199 00000100:00100000:2.0:1787115022.601608:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:0.0:1787115022.601710:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c90b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.601725:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c90b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.601734:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c90b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.601740:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115022.601746:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c90b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.601754:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c90b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.601773:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8af0510d6200) 00010000:00010000:0.0:1787115022.601776:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115022.601781:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c90b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.601831:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c90b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115022.602636:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602628864 00000100:00100000:1.0:1787115022.602648:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602628864 00000100:00100000:1.0:1787115022.602720:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 59 00000100:00100000:1.0:1787115022.602730:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2363:x1873925602628864:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:1.0:1787115022.602747:0:6577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115022.602765:0:6577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c90c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1749 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787115022.602789:0:6577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00080000:0.0:1787115022.602945:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787115022.603063:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=351s v=(0 0) 00010000:00010000:1.0:1787115022.603068:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787115022.603075:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c90c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1749 expref: 6 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.603090:0:6577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c90c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1749 expref: 6 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.603100:0:6577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a1000, rc 0) 00000100:00100000:1.0:1787115022.603172:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2363:x1873925602628864:12345-192.168.202.10@tcp:101:bash.0 Request processed in 445us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115022.603185:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 59 00000100:00100000:0.0:1787115022.620093:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115022.620859:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602628992 00000100:00100000:1.0:1787115022.620871:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602628992 00000100:00100000:1.0:1787115022.621859:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 60 00000100:00100000:1.0:1787115022.621882:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:11544:x1873925602628992:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:1.0:1787115022.622129:0:6578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115022.622152:0:6578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c90cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1750 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.622192:0:6578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c90c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1749 expref: 7 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.622202:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787115022.622207:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787115022.622212:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c90cc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1750 expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.622260:0:6578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c90c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1749 expref: 7 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.622277:0:6578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c90c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1749 expref: 7 pid: 6577 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115022.622292:0:6578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b472d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6578:1873925624639872:192.168.202.10@tcp:104: 00000100:00100000:1.0:1787115022.622394:0:6578:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042d2d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787115022.630839:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115022.631382:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602629120 00000100:00100000:3.0:1787115022.631402:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602629120 00000100:00100000:1.0:1787115022.631433:0:6578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b472d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6578:1873925624639872:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787115022.631476:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c90c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1749 expref: 8 pid: 6577 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.631485:0:6578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c90cc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1750 expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.631522:0:6578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a1a00, rc 0) 00000100:00100000:3.0:1787115022.631564:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 74 00000100:00100000:3.0:1787115022.631578:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2363:x1873925602629120:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787115022.631599:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787115022.631630:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c90c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1749 expref: 8 pid: 6577 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.631648:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c90c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1749 expref: 8 pid: 6577 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.631681:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c90c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1749 expref: 8 pid: 6577 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.631702:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115022.631707:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115022.631717:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c90cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1750 expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.631730:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c90cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1750 expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115022.631785:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:11544:x1873925602628992:12345-192.168.202.10@tcp:101:bash.0 Request processed in 9908us (11698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115022.631798:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 60 00010000:00010000:3.0:1787115022.631803:0:5771:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c90cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1750 expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115022.631840:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5771:1873925624640000:192.168.202.10@tcp:105: 00000100:00100000:3.0:1787115022.634085:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f0edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787115022.636882:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5771:1873925624640000:192.168.202.10@tcp:105: 00010000:00010000:0.0:1787115022.636995:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787115022.638036:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2363:x1873925602629120:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 6455us (7209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115022.638049:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 74 00000100:00100000:2.0:1787115022.645703:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115022.645765:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602629376 00000100:00100000:0.0:1787115022.645785:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602629376 00000100:00100000:0.0:1787115022.645893:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 55 00000100:00100000:0.0:1787115022.645907:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+38:11544:x1873925602629376:12345-192.168.202.10@tcp:35:bash.0 00000100:00100000:0.0:1787115022.646418:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+39:11544:x1873925602629376:12345-192.168.202.10@tcp:35:bash.0 Request processed in 513us (724us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1787115022.646427:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 55 00010000:00010000:1.0:1787115022.666180:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787115022.857688:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115022.863768:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602629504 00000100:00100000:0.0:1787115022.863788:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602629504 00000100:00100000:0.0:1787115022.863887:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 200 00000100:00100000:0.0:1787115022.863899:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+39:11560:x1873925602629504:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1787115022.863932:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115022.863958:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c90d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1757 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.864069:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c90da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.864085:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c90da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.864099:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c90da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115022.864183:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787115022.864188:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787115022.864217:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c90da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.864255:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c90d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1757 expref: 41 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.864274:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c90da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1757 expref: 40 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.864283:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:0.0:1787115022.864285:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787115022.864289:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030c00, rc 0) 00000100:00100000:0.0:1787115022.864377:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+40:11560:x1873925602629504:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 480us (6697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115022.864385:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 200 00000100:00100000:1.0:1787115022.869181:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115022.869558:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602629760 00000100:00100000:2.0:1787115022.869573:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602629760 00000100:00100000:2.0:1787115022.873478:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 201 00000100:00100000:2.0:1787115022.873491:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+40:11560:x1873925602629760:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1787115022.873513:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115022.873536:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c90e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d175e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.873660:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c90e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.873674:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c90e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.873686:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c90e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115022.873700:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787115022.873868:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c90e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d175e expref: 43 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.873889:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c90e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d175e expref: 42 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.873898:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af0510d6300) 00010000:00010000:2.0:1787115022.873901:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787115022.873905:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2400, rc 0) 00000100:00100000:2.0:1787115022.873987:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+42:11560:x1873925602629760:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 499us (4887us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787115022.873995:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 201 00000100:00100000:2.0:1787115022.884072:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115022.887173:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602629888 00000100:00100000:1.0:1787115022.887197:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602629888 00000100:00100000:1.0:1787115022.887317:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15 00000100:00100000:1.0:1787115022.887328:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+42:2364:x1873925602629888:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787115022.887354:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787115022.887391:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c90e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d175e expref: 42 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.887423:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af0510d6300) 00010000:00010000:1.0:1787115022.887429:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787115022.887527:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+41:2364:x1873925602629888:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 201us (3464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115022.887535:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15 00000100:00100000:3.0:1787115022.889717:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115022.891859:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602630144 00000100:00100000:0.0:1787115022.891876:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602630144 00000100:00100000:1.0:1787115022.892600:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 202 00000100:00100000:1.0:1787115022.892620:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+41:11560:x1873925602630144:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1787115022.892656:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115022.892699:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c90f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1765 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.892864:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c90fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.892881:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c90fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.892894:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c90fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787115022.892909:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787115022.893369:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c90f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1765 expref: 44 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.893463:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c90fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1765 expref: 43 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.893475:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af0510d6300) 00010000:00010000:1.0:1787115022.893478:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787115022.893481:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a1000, rc 0) 00000100:00100000:1.0:1787115022.893576:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+43:11560:x1873925602630144:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 965us (3872us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1787115022.893584:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 202 00000100:00100000:2.0:1787115022.921938:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115022.922096:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602630272 00000100:00100000:3.0:1787115022.922144:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602630272 00000100:00100000:3.0:1787115022.922203:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 61 00000100:00100000:3.0:1787115022.922213:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ee8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+6:2361:x1873925602630272:12345-192.168.202.10@tcp:1:lfs.0 00010000:00010000:3.0:1787115022.922272:0:6576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c910b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.922295:0:6576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c90cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1750 expref: 6 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.922304:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115022.922319:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787115022.922325:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c910b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.922363:0:6576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c90cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1750 expref: 6 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.922553:0:6576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c90cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1750 expref: 6 pid: 6578 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115022.922573:0:6576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6576:1873925624640128:192.168.202.10@tcp:104: 00000100:00100000:3.0:1787115022.922682:0:6576:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f0ed600 going to sleep for 11 seconds 00000100:00100000:3.0:1787115022.927325:0:6576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6576:1873925624640128:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787115022.927380:0:6576:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c910b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115022.935897:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115022.936067:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602630400 00000100:00100000:0.0:1787115022.936085:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602630400 00002000:00100000:0.0:1787115022.936192:0:6583:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8af06ee8c700 x1873925602630400/t0(0) o4->6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp:588/0 lens 504/0 e 0 to 0 dl 1787115033 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787115022.936208:0:6583:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af06ee8c700 with x1873925602630400 ext(0->8) 00010000:00010000:0.0:1787115022.936221:0:6583:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c90cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1750 expref: 7 pid: 6578 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.936244:0:6583:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c90cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1750 expref: 7 pid: 6578 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787115022.936255:0:6583:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8af06ee8c700 00000100:00100000:0.0:1787115022.936300:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 3 00000100:00100000:0.0:1787115022.936313:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ee8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2363:x1873925602630400:12345-192.168.202.10@tcp:4:lfs.0 00000100:00100000:0.0:1787115022.937698:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ee8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:2363:x1873925602630400:12345-192.168.202.10@tcp:4:lfs.0 Request processed in 1376us (1806us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787115022.937715:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 3 00002000:00100000:0.0:1787115022.937729:0:6583:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8af06ee8c700 x1873925602630400/t4294967308(0) o4->6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp:588/0 lens 504/448 e 0 to 0 dl 1787115033 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787115022.937740:0:6583:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af06ee8c700 with x1873925602630400 ext(0->8) 00010000:00010000:0.0:1787115022.937762:0:6583:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c90cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1750 expref: 9 pid: 6578 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.937786:0:6583:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c90cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1750 expref: 9 pid: 6578 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787115022.937832:0:6583:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8af06ee8c700 00000100:00100000:2.0:1787115022.946001:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115022.946243:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602630528 00000100:00100000:1.0:1787115022.946258:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602630528 00010000:00010000:1.0:1787115022.946322:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c90cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1750 expref: 9 pid: 6578 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115022.946423:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 75 00000100:00100000:1.0:1787115022.946436:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ee8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:2364:x1873925602630528:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787115022.946460:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787115022.946487:0:5772:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787115022.946491:0:5772:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787115023 00002000:00010000:1.0:1787115022.946493:0:5772:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787115023 00002000:00010000:1.0:1787115022.946505:0:5772:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787115023 00010000:00010000:1.0:1787115022.946513:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c90cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1750 expref: 9 pid: 6578 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.946530:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c90cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1750 expref: 9 pid: 6578 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.946559:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c90cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1750 expref: 9 pid: 6578 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.946580:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787115022.946585:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787115022.946593:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c910b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.946605:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c910b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115022.946649:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787115022.946730:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ee8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2364:x1873925602630528:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 296us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115022.946738:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 75 00010000:00010000:3.0:1787115022.949191:0:6576:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c910b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.949215:0:6576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c910b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.949273:0:6576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c910b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.949408:0:6576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c910b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.949420:0:6576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c910b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.949456:0:6576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682000 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:3.0:1787115022.949462:0:6576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c910b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.949472:0:6576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c910b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.949500:0:6576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c910b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.949508:0:6576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f75d670d/0x194cd781e88c910b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115022.949949:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ee8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2361:x1873925602630272:12345-192.168.202.10@tcp:1:lfs.0 Request processed in 27729us (28014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115022.949962:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 61 00000100:00100000:2.0:1787115022.955087:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115022.955168:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602630784 00000100:00100000:0.0:1787115022.955497:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602630784 00000100:00100000:0.0:1787115022.955585:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 56 00000100:00100000:0.0:1787115022.955597:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af066348050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+43:11560:x1873925602630784:12345-192.168.202.10@tcp:35:lfs.0 00000004:00010000:0.0:1787115022.955694:0:5789:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c90fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1765 expref: 43 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787115022.956581:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1787115022.956638:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1787115022.957458:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1787115022.957577:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9112 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.957600:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c90b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1742 expref: 47 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.957609:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9112 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.957665:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c90b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1742 expref: 47 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.957691:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c90b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1742 expref: 47 pid: 7216 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115022.957710:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5789:1873925624640256:192.168.202.10@tcp:104: 00000100:00100000:0.0:1787115022.957864:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050797180 going to sleep for 11 seconds 00000100:00100000:2.0:1787115022.967985:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115022.968192:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5789:1873925624640256:192.168.202.10@tcp:104: 00010000:00010000:0.0:1787115022.968233:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9112 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115022.968574:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602630912 00000100:00100000:3.0:1787115022.968584:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602630912 00010000:00010000:2.0:1787115022.968730:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c90b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1742 expref: 48 pid: 7216 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115022.968850:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 76 00000100:00100000:2.0:1787115022.968863:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ee8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+48:2361:x1873925602630912:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115022.968884:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115022.968892:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c90b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1742 expref: 48 pid: 7216 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.968907:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c90b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1742 expref: 48 pid: 7216 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.968936:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c90b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1742 expref: 48 pid: 7216 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.968959:0:6592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af0510d6300) 00010000:00010000:2.0:1787115022.968965:0:6592:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9112 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.968976:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9112 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.968984:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9112 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115022.969038:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115022.969162:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ee8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+47:2361:x1873925602630912:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 301us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115022.969171:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 76 00010000:00010000:0.0:1787115022.969516:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9112 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.969526:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9112 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787115022.969703:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787115022.969980:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1787115022.970142:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1873925624640384:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787115022.970389:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115022.970455:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045be1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787115022.972304:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624640384 00000100:00100000:3.0:1787115022.972327:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624640384 00000100:00100000:3.0:1787115022.972424:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787115022.972436:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5789:x1873925624640384:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787115022.972597:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5789:x1873925624640384:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 163us (2216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115022.972605:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787115022.972769:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1873925624640384:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787115022.973440:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1787115022.973671:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af042cb8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1873925624640512:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787115022.973803:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115022.973862:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050797180 going to sleep for 11 seconds 00000100:00100000:3.0:1787115022.975037:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624640512 00000100:00100000:3.0:1787115022.975050:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624640512 00000100:00100000:3.0:1787115022.975157:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787115022.975170:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5789:x1873925624640512:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787115022.975405:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5789:x1873925624640512:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 238us (1601us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787115022.975412:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787115022.975911:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af042cb8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5789:1873925624640512:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787115022.975983:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1787115022.976030:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9112 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.976042:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9112 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.976067:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9112 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.976074:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030a00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115022.976078:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9112 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.976086:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9112 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.976246:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af0510d6300) 00010000:00010000:0.0:1787115022.976250:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787115022.976256:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9112 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115022.976263:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9112 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787115022.976449:0:5789:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787115022.976630:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1787115022.976642:0:5789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 351962533596ns, next at 352962531549ns, rc = 0 00000001:00080000:0.0:1787115022.976648:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1787115022.976682:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af0510d6300) 00010000:00010000:0.0:1787115022.976686:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787115022.976693:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c90fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1765 expref: 51 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115022.976813:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af066348050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+50:11560:x1873925602630784:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 21219us (21739us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1787115022.976844:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 56 00000020:00080000:0.0:1787115022.976849:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787115022.982447:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115022.982544:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602631040 00000100:00100000:3.0:1787115022.982556:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602631040 00000100:00100000:3.0:1787115022.982621:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 203 00000100:00100000:3.0:1787115022.982633:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ee8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+50:11560:x1873925602631040:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1787115022.982662:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115022.982689:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c9119 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d176c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.982758:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c9119 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d176c expref: 51 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.982774:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c9119 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d176c expref: 51 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115022.982795:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:3.0:1787115022.982798:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787115022.982802:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041682000, rc 0) 00000100:00100000:3.0:1787115022.982889:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ee8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+51:11560:x1873925602631040:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 259us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115022.982897:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 203 00000100:00100000:2.0:1787115023.003078:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115023.003703:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602631296 00000100:00100000:1.0:1787115023.003715:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602631296 00000100:00100000:1.0:1787115023.003772:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 57 00000100:00100000:1.0:1787115023.003782:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ee8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+51:11560:x1873925602631296:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:1.0:1787115023.004192:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ee8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+52:11560:x1873925602631296:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 411us (1138us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1787115023.004200:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 57 00000100:00100000:2.0:1787115023.128848:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115023.128923:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602631424 00000100:00100000:3.0:1787115023.128933:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602631424 00000100:00100000:3.0:1787115023.128988:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 204 00000100:00100000:3.0:1787115023.128996:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ee8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+52:11570:x1873925602631424:12345-192.168.202.10@tcp:34:lfs.0 00010000:00010000:3.0:1787115023.129067:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9120 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129082:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9120 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129094:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9120 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129148:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9127 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129155:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129161:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129272:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c912e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129280:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c912e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129287:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c912e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787115023.129347:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c912e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129380:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9120 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129386:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9120 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129393:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9120 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129400:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115023.129405:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9120 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129413:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9120 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129426:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:3.0:1787115023.129428:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115023.129432:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9120 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129437:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9120 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129450:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129455:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9127 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129460:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9127 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129470:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115023.129473:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9127 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129478:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9127 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129485:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8af044d99900) 00010000:00010000:3.0:1787115023.129487:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115023.129489:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9127 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129494:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9127 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129507:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c912e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129513:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c912e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129518:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c912e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129523:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041683000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115023.129525:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c912e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129530:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c912e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129544:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:3.0:1787115023.129546:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115023.129549:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c912e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.129554:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c912e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115023.129625:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ee8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+52:11570:x1873925602631424:12345-192.168.202.10@tcp:34:lfs.0 Request processed in 629us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115023.129633:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 204 00000100:00100000:2.0:1787115023.165917:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115023.166169:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602631680 00000100:00100000:3.0:1787115023.166181:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602631680 00000100:00100000:3.0:1787115023.166289:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 205 00000100:00100000:3.0:1787115023.166309:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ee8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+52:11573:x1873925602631680:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1787115023.166331:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115023.166352:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c9135 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1773 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.166431:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c913c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.166447:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c913c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.166461:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c913c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.166477:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9143 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.166500:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.166508:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.166660:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c914a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.166668:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c914a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.166676:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c914a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787115023.166686:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787115023.166793:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c913c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.166800:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c913c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.166807:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c913c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.166831:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115023.166837:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c913c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.166845:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c913c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.167075:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:3.0:1787115023.167079:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115023.167084:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c913c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.167091:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c913c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.167150:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.167157:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9143 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.167163:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9143 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.167168:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115023.167171:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9143 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.167177:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9143 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.167185:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8af044d99900) 00010000:00010000:3.0:1787115023.167187:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115023.167190:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9143 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.167196:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9143 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.167251:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c9135 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1773 expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.167266:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c914a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1773 expref: 54 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.167274:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:3.0:1787115023.167276:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787115023.167278:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041682200, rc 0) 00000100:00100000:3.0:1787115023.167354:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ee8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+54:11573:x1873925602631680:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1047us (1447us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1787115023.167362:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 205 00000100:00100000:2.0:1787115023.173606:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115023.173700:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602631808 00000100:00100000:3.0:1787115023.173713:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602631808 00000100:00100000:3.0:1787115023.173786:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 206 00000100:00100000:3.0:1787115023.173796:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ee8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+54:11573:x1873925602631808:12345-192.168.202.10@tcp:54:lfs.0 00010000:00010000:3.0:1787115023.173905:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9158 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.173926:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.173939:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.173969:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.173996:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9158 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.174003:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9158 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.174010:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115023.174014:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9158 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.174022:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9158 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.174036:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:3.0:1787115023.174039:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787115023.174044:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9158 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.174050:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9158 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115023.174200:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ee8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+54:11573:x1873925602631808:12345-192.168.202.10@tcp:54:lfs.0 Request processed in 404us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115023.174208:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 206 00000100:00100000:2.0:1787115023.186951:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115023.187012:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602632064 00000100:00100000:0.0:1787115023.187021:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602632064 00000100:00100000:0.0:1787115023.187072:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 58 00000100:00100000:0.0:1787115023.187080:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ee8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+54:11573:x1873925602632064:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:0.0:1787115023.187335:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ee8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+55:11573:x1873925602632064:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 254us (393us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1787115023.187343:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 58 00000100:00100000:2.0:1787115023.280594:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115023.281352:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602632320 00000100:00100000:0.0:1787115023.281369:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602632320 00000100:00100000:0.0:1787115023.281467:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 207 00000100:00100000:0.0:1787115023.281479:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ee8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+55:11583:x1873925602632320:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:0.0:1787115023.281520:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115023.281525:0:7216:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787115023.281564:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c90da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1757 expref: 55 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.281590:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:0.0:1787115023.281595:0:7216:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787115023.281612:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c915f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d177a expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.281755:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9166 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.281772:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.281806:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115023.281831:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787115023.282036:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c915f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d177a expref: 57 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.282054:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d177a expref: 56 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.282062:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:0.0:1787115023.282066:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787115023.282068:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040031600, rc 0) 00000100:00100000:0.0:1787115023.282316:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ee8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+56:11583:x1873925602632320:12345-192.168.202.10@tcp:101:bash.0 Request processed in 839us (1737us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787115023.282325:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 207 00000100:00100000:2.0:1787115023.286524:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115023.286902:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602632576 00000100:00100000:3.0:1787115023.286919:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602632576 00000100:00100000:3.0:1787115023.287014:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 208 00000100:00100000:3.0:1787115023.287030:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ee8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+56:11583:x1873925602632576:12345-192.168.202.10@tcp:36:bash.0 00010000:00010000:3.0:1787115023.287152:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787115023.287431:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9166 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d177a expref: 56 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.287460:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c914a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1773 expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.287473:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:3.0:1787115023.287480:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787115023.287903:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9174 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.287921:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.287934:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787115023.288806:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1787115023.288872:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004223c073 reply state 00000000f043094a transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115023.288886:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787115023.289876:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ee8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+57:11583:x1873925602632576:12345-192.168.202.10@tcp:36:bash.0 Request processed in 2838us (3358us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1787115023.289890:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 208 00000020:00080000:3.0:1787115023.289902:0:5785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787115023.300902:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.300932:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9174 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.300966:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9174 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.300973:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115023.300979:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9174 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.300989:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9174 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.301011:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:3.0:1787115023.301015:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115023.301020:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9174 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.301027:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c9174 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115023.301623:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115023.301694:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602632704 00000100:00100000:3.0:1787115023.301707:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602632704 00000100:00100000:3.0:1787115023.301774:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 209 00000100:00100000:3.0:1787115023.301785:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+56:11583:x1873925602632704:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:3.0:1787115023.301828:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115023.301855:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c917b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1781 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.302060:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9182 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.302076:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9182 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.302095:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9182 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787115023.302171:0:7216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787115023.302176:0:7216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787115023.302201:0:7216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9182 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.302231:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c917b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1781 expref: 58 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.302250:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9182 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1781 expref: 57 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.302260:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:3.0:1787115023.302262:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787115023.302266:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041682400, rc 0) 00000100:00100000:3.0:1787115023.302336:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+57:11583:x1873925602632704:12345-192.168.202.10@tcp:101:bash.0 Request processed in 552us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115023.302344:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 209 00000100:00100000:2.0:1787115023.309186:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115023.309366:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602632960 00000100:00100000:3.0:1787115023.309380:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602632960 00000100:00100000:3.0:1787115023.309453:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 59 00000100:00100000:3.0:1787115023.309464:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ee8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+57:11583:x1873925602632960:12345-192.168.202.10@tcp:35:bash.0 00000100:00100000:3.0:1787115023.309808:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ee8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+58:11583:x1873925602632960:12345-192.168.202.10@tcp:35:bash.0 Request processed in 344us (635us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1787115023.309826:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 59 00000100:00100000:1.0:1787115023.395389:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115023.395525:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602633088 00000100:00100000:2.0:1787115023.395539:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602633088 00000100:00100000:2.0:1787115023.395661:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 210 00000100:00100000:2.0:1787115023.395675:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+58:11589:x1873925602633088:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1787115023.395708:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115023.395735:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c9189 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1788 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.395836:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c9190 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.395854:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c9190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.395870:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c9190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115023.395977:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787115023.395983:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787115023.396012:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c9190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.396042:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c9189 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1788 expref: 60 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.396065:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c9190 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1788 expref: 59 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.396076:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:2.0:1787115023.396080:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787115023.396084:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2400, rc 0) 00000100:00100000:2.0:1787115023.396268:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+59:11589:x1873925602633088:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 595us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115023.396277:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 210 00000100:00100000:2.0:1787115023.400939:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115023.401074:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602633216 00000100:00100000:1.0:1787115023.401087:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602633216 00000100:00100000:1.0:1787115023.401223:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 211 00000100:00100000:1.0:1787115023.401235:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ee8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+59:11589:x1873925602633216:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1787115023.401264:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115023.401289:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c9197 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d178f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.401372:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c919e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.401390:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c919e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.401404:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c919e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.401445:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c91a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.401453:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c91a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.401460:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c91a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.401582:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c91ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.402936:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c91ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.402952:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c91ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787115023.403010:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787115023.403015:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787115023.403038:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c91ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.403053:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c91ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.403063:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c919e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.403070:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c919e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.403101:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c919e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.403124:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115023.403129:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c919e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.403138:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c919e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.403153:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:1.0:1787115023.403156:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787115023.403162:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c919e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.403169:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c919e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.403188:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c91a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.403195:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c91a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.403201:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c91a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.403206:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115023.403209:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c91a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.403225:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c91a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.403234:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8af0510d6900) 00010000:00010000:1.0:1787115023.403236:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787115023.403239:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c91a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.403244:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c91a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.403295:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c9197 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d178f expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.403311:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c91ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d178f expref: 60 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.403321:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:1.0:1787115023.403323:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787115023.403326:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a1800, rc 0) 00000100:00100000:1.0:1787115023.403434:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ee8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+60:11589:x1873925602633216:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 2199us (2510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115023.403444:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 211 00000100:00100000:0.0:1787115023.406361:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115023.406472:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602633472 00000100:00100000:3.0:1787115023.406486:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602633472 00000100:00100000:3.0:1787115023.406561:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 212 00000100:00100000:3.0:1787115023.406573:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+60:11589:x1873925602633472:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:3.0:1787115023.406600:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115023.406629:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c91b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1796 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.406749:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c91ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.406762:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9182 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1781 expref: 61 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.406769:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c91ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d178f expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.406775:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c91ba lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.406828:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c91ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d178f expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.406848:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c91ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d178f expref: 61 pid: 5786 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115023.406865:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1873925624640640:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787115023.410706:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9182 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1781 expref: 61 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.410752:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9182 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1781 expref: 61 pid: 7216 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115023.410771:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1873925624640768:192.168.202.10@tcp:104: 00000100:00100000:3.0:1787115023.410810:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f0ed600 going to sleep for 11 seconds 00000100:00100000:1.0:1787115023.411664:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115023.411855:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602633600 00000100:00100000:2.0:1787115023.411866:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602633600 00010000:00010000:2.0:1787115023.411911:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c91ac lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d178f expref: 62 pid: 5786 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115023.411953:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 77 00000100:00100000:2.0:1787115023.411962:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b473800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+62:2362:x1873925602633600:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115023.411978:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115023.411987:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c91ac lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d178f expref: 62 pid: 5786 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.412018:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c91ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d178f expref: 62 pid: 5786 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.412046:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:2.0:1787115023.412056:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c91ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.412070:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c91ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.412077:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115023.412147:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b473800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+62:2362:x1873925602633600:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 185us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115023.412154:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 77 00000100:00100000:1.0:1787115023.417033:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115023.417146:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602633728 00000100:00100000:0.0:1787115023.417159:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602633728 00010000:00010000:0.0:1787115023.417212:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9182 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1781 expref: 62 pid: 7216 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115023.417266:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 78 00000100:00100000:0.0:1787115023.417278:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b471880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+62:2363:x1873925602633728:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787115023.417298:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787115023.417306:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9182 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1781 expref: 62 pid: 7216 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.417348:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9182 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1781 expref: 62 pid: 7216 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.417385:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:0.0:1787115023.417391:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c91ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.417402:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c91ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.417411:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c91ba lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.417434:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787115023.417509:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b471880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+62:2363:x1873925602633728:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 232us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115023.417517:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 78 00010000:00010000:3.0:1787115023.417914:0:5785:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.10@tcp) returned -22 from blocking AST (req@000000007e8c6bd1 x1873925624640640) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c91ac lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d178f expref: 61 pid: 5786 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.417933:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c91ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d178f expref: 61 pid: 5786 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115023.417950:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1873925624640640:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787115023.417969:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c9182 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1781 expref: 60 pid: 7216 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115023.417995:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1873925624640768:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787115023.418017:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:3.0:1787115023.418024:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c91ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.418035:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c91ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.418040:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c91ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787115023.418078:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787115023.418327:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c91b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1796 expref: 61 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.418345:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c91ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1796 expref: 60 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.418353:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:3.0:1787115023.418355:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787115023.418358:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041682c00, rc 0) 00000100:00100000:3.0:1787115023.418661:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+60:11589:x1873925602633472:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 12088us (12314us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1787115023.418671:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 212 00000100:00100000:1.0:1787115023.428798:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115023.428926:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602633984 00000100:00100000:2.0:1787115023.428939:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602633984 00000100:00100000:2.0:1787115023.429029:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16 00000100:00100000:2.0:1787115023.429041:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b470000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+60:11589:x1873925602633984:12345-192.168.202.10@tcp:103:lfs.0 00010000:00010000:2.0:1787115023.429064:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115023.429097:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682000/0x194cd781e88c9119 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d176c expref: 60 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.429161:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:2.0:1787115023.429168:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115023.429242:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b470000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+59:11589:x1873925602633984:12345-192.168.202.10@tcp:103:lfs.0 Request processed in 202us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115023.429271:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16 00000100:00100000:0.0:1787115023.432293:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115023.432362:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602634112 00000100:00100000:3.0:1787115023.432444:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602634112 00000100:00100000:0.0:1787115023.432626:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 213 00000100:00100000:0.0:1787115023.432638:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+59:11589:x1873925602634112:12345-192.168.202.10@tcp:58:lfs.0 00010000:00010000:0.0:1787115023.432798:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c91c8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.432829:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c91c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.432845:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c91c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787115023.433316:0:7216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1787115023.433629:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+59:11589:x1873925602634112:12345-192.168.202.10@tcp:58:lfs.0 Request processed in 991us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115023.433639:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 213 00000100:00100000:1.0:1787115023.436915:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115023.437078:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602634240 00000100:00100000:2.0:1787115023.437093:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602634240 00000100:00100000:2.0:1787115023.437200:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 214 00000100:00100000:2.0:1787115023.437215:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+59:11589:x1873925602634240:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1787115023.437252:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115023.437281:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c91cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d179d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.437774:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c91c8 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.437786:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c91cf lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d179d expref: 60 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.437807:0:5787:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c91c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.437832:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c91cf lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d179d expref: 60 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.437847:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:2.0:1787115023.437850:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787115023.437852:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c91cf lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d179d expref: 60 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.437858:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2200, rc 0) 00000100:00100000:2.0:1787115023.437945:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+60:11589:x1873925602634240:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 734us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115023.437953:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 214 00010000:00010000:1.0:1787115023.686043:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787115023.688735:0:11519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787115023.688746:0:11519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787115023.688781:0:11519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787115023.688786:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787115023.688950:0:11519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06ee8f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11519:1873925624640896:192.168.202.10@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787115023.689080:0:11519:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af05470f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787115023.703405:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115023.703492:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602634368 00000100:00100000:3.0:1787115023.703502:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602634368 00000100:00100000:3.0:1787115023.703567:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 215 00000100:00100000:3.0:1787115023.703577:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+61:11590:x1873925602634368:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787115023.703629:0:5786:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787115023.703743:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+61:11590:x1873925602634368:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 Request processed in 167us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115023.703751:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 215 00000100:00100000:2.0:1787115023.704788:0:11519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06ee8f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11519:1873925624640896:192.168.202.10@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787115023.718607:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115023.719018:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602634496 00000100:00100000:3.0:1787115023.719028:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602634496 00000100:00100000:3.0:1787115023.719090:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 216 00000100:00100000:3.0:1787115023.719141:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+60:11590:x1873925602634496:12345-192.168.202.10@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787115023.719407:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c91d6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.719425:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c91d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.719437:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c91d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.719497:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c91dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.719505:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c91dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.719511:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c91dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.719534:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c91e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.719542:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c91e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.719548:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c91e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787115023.720259:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787115023.720352:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787115023.720369:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c91e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.720403:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c91d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.720411:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c91d6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.720418:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c91d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.720425:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041683000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115023.720429:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c91d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.720438:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c91d6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.720452:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8af0510d6d00) 00010000:00010000:3.0:1787115023.720455:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115023.720460:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c91d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.720466:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c91d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.720483:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c91dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.720488:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c91dd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.720493:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c91dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.720504:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115023.720508:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c91dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.720514:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c91dd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.720522:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8af044d99900) 00010000:00010000:3.0:1787115023.720525:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115023.720527:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c91dd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.720533:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c91dd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.720550:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c91e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.720555:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c91e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.720560:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c91e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.720564:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115023.720566:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c91e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.720572:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c91e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.720691:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:3.0:1787115023.720694:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115023.720698:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c91e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.720704:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c91e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115023.720862:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+60:11590:x1873925602634496:12345-192.168.202.10@tcp:34:lhsmtool_posix.0 Request processed in 1723us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115023.720871:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 216 00000100:00100000:0.0:1787115023.735962:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115023.736017:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602634752 00000100:00100000:3.0:1787115023.736028:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602634752 00000100:00100000:3.0:1787115023.736089:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 217 00000100:00100000:3.0:1787115023.736099:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+60:11590:x1873925602634752:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787115023.736147:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115023.736182:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c91eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d17a4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.736305:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c91f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.736320:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c91f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.736337:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c91f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787115023.736348:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787115023.736467:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c91f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.736474:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c91f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.736481:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c91f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.736488:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115023.736492:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c91f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.736501:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c91f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.736516:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:3.0:1787115023.736519:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787115023.736524:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c91f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.736530:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682400/0x194cd781e88c91f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.736578:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c91eb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17a4 expref: 62 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.736587:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8af0510d6d00) 00010000:00010000:3.0:1787115023.736601:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787115023.736605:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c91eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17a4 expref: 62 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.736624:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041682200, rc 0) 00000100:00100000:3.0:1787115023.736679:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+61:11590:x1873925602634752:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 582us (726us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1787115023.736686:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 217 00000100:00100000:1.0:1787115023.740334:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115023.740541:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602634880 00000100:00100000:2.0:1787115023.740553:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602634880 00000100:00100000:2.0:1787115023.740621:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 218 00000100:00100000:2.0:1787115023.740631:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+61:11590:x1873925602634880:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787115023.740665:0:5787:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787115023.740757:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+61:11590:x1873925602634880:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 Request processed in 127us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115023.740764:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 218 00000100:00100000:1.0:1787115023.747642:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115023.747777:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602635136 00000100:00100000:3.0:1787115023.747791:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602635136 00000100:00100000:3.0:1787115023.747865:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 219 00000100:00100000:3.0:1787115023.747874:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+61:11590:x1873925602635136:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787115023.747895:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115023.747898:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787115023.747925:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c9190 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1788 expref: 61 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.747946:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:3.0:1787115023.747952:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787115023.747968:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c9200 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d17ab expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787115023.749023:0:5786:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1787115023.749968:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c9207 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.749997:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c9207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.750009:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c9207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.750095:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c9200 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17ab expref: 63 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.750128:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c9207 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17ab expref: 62 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.750137:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8af0514c6c00) 00010000:00010000:2.0:1787115023.750139:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787115023.750142:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2800, rc 0) 00000100:00100000:2.0:1787115023.750798:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+62:11590:x1873925602635136:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 2923us (3164us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787115023.750817:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 219 00000100:00100000:0.0:1787115023.769449:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115023.769528:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602635392 00000100:00100000:2.0:1787115023.769538:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602635392 00000100:00100000:2.0:1787115023.769593:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 220 00000100:00100000:2.0:1787115023.769601:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+62:11590:x1873925602635392:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787115023.769653:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115023.769677:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c9207 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17ab expref: 62 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.769695:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8af0514c6c00) 00010000:00010000:2.0:1787115023.769706:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787115023.769723:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c9215 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.769737:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c9215 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.769759:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c9215 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.769794:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c921c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x529acf97 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.769801:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c921c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x529acf97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.769817:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c921c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x529acf97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.769890:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c9215 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.769898:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c9215 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.769904:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c9215 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.769910:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115023.769914:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c9215 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.769921:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c9215 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.769929:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:2.0:1787115023.769932:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115023.769936:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c9215 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.769947:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c9215 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.769956:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c921c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x529acf97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.769961:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c921c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x529acf97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.769967:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c921c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x529acf97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.769981:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115023.769984:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c921c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x529acf97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.769990:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c921c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x529acf97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.769996:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x529acf97 (ffff8af0514c6a00) 00010000:00010000:2.0:1787115023.769999:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115023.770001:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c921c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x529acf97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.770008:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c921c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x529acf97 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115023.770085:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+61:11590:x1873925602635392:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 Request processed in 484us (646us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787115023.770092:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 220 00000100:00100000:1.0:1787115023.777017:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115023.777136:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602635520 00000100:00100000:0.0:1787115023.777146:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602635520 00000100:00100000:0.0:1787115023.777199:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 221 00000100:00100000:0.0:1787115023.777208:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+61:11590:x1873925602635520:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787115023.777229:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115023.777252:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9223 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d17b2 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.777286:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c922a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.777300:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c922a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.777313:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c922a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.777415:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9223 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17b2 expref: 63 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.777434:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c922a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17b2 expref: 62 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.777454:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8af051ecbe00) 00010000:00010000:0.0:1787115023.777457:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787115023.777460:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030a00, rc 0) 00000100:00100000:0.0:1787115023.777519:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+62:11590:x1873925602635520:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 312us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115023.777525:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 221 00000100:00100000:1.0:1787115023.780359:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115023.780452:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602635776 00000100:00100000:2.0:1787115023.780462:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602635776 00000100:00100000:2.0:1787115023.780519:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 222 00000100:00100000:2.0:1787115023.780529:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+62:11590:x1873925602635776:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787115023.780613:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c9231 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.780629:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c9231 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.780642:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c9231 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787115023.780938:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1787115023.780948:0:5787:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352766839597ns, next at 353766837322ns, rc = 0 00000004:00010000:2.0:1787115023.781047:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c56a716e reply state 00000000ed24d401 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c9231 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115023.781057:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787115023.781197:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+64:11590:x1873925602635776:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 Request processed in 668us (845us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787115023.781204:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 222 00010000:00010000:0.0:1787115023.785201:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c9231 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.785223:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c9231 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.785230:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c9231 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.785236:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115023.785241:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c9231 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.785249:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c9231 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.785267:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8af051ecbe00) 00010000:00010000:0.0:1787115023.785270:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787115023.785274:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c9231 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.785280:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c9231 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115023.786490:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115023.786667:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602635904 00000100:00100000:0.0:1787115023.786678:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602635904 00000100:00100000:0.0:1787115023.786742:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 223 00000100:00100000:0.0:1787115023.786752:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+63:11590:x1873925602635904:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787115023.786781:0:7216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115023.786802:0:7216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9238 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d17b9 expref: -99 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.786884:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9238 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17b9 expref: 64 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.786899:0:7216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9238 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17b9 expref: 64 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.786920:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8af051ecbe00) 00010000:00010000:0.0:1787115023.786923:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787115023.786926:0:7216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030c00, rc 0) 00000100:00100000:0.0:1787115023.787510:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+64:11590:x1873925602635904:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 758us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115023.787519:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 223 00000100:00100000:1.0:1787115023.797783:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115023.798305:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602636032 00000100:00100000:3.0:1787115023.798316:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602636032 00000100:00100000:3.0:1787115023.798441:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 62 00000100:00100000:3.0:1787115023.798452:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:2364:x1873925602636032:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787115023.798770:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+10:2364:x1873925602636032:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 Request processed in 319us (997us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787115023.798779:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 62 00000100:00080000:0.0:1787115023.799010:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787115023.802410:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115023.802766:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602636288 00000100:00100000:3.0:1787115023.802776:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602636288 00000100:00100000:3.0:1787115023.802849:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 60 00000100:00100000:3.0:1787115023.802859:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ee8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+64:11590:x1873925602636288:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787115023.803159:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ee8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+65:11590:x1873925602636288:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 Request processed in 300us (759us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1787115023.803168:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 60 00000100:00100000:3.0:1787115023.805188:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115023.805313:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602636544 00000100:00100000:2.0:1787115023.805322:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602636544 00000100:00100000:2.0:1787115023.805374:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 224 00000100:00100000:2.0:1787115023.805383:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+65:11590:x1873925602636544:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787115023.805485:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+65:11590:x1873925602636544:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 Request processed in 102us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115023.805511:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 224 00000100:00100000:2.0:1787115023.812045:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115023.812148:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602636672 00000100:00100000:1.0:1787115023.812158:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602636672 00000100:00100000:1.0:1787115023.812237:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 225 00000100:00100000:1.0:1787115023.812249:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ee8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+65:11590:x1873925602636672:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787115023.812272:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115023.812294:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c923f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d17c0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.812395:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c9246 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.812409:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c9246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.812421:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c9246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787115023.812463:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787115023.812485:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c9246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.812511:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c923f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17c0 expref: 67 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.812540:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c9246 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17c0 expref: 66 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.812549:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8af051ecbe00) 00010000:00010000:1.0:1787115023.812552:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787115023.812556:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0800, rc 0) 00000100:00100000:1.0:1787115023.812879:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ee8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+66:11590:x1873925602636672:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 631us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115023.812886:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 225 00000100:00100000:0.0:1787115023.816965:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115023.817252:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602636800 00000100:00100000:1.0:1787115023.817349:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602636800 00000100:00100000:1.0:1787115023.817460:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 63 00000100:00100000:1.0:1787115023.817470:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+10:2364:x1873925602636800:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787115023.817489:0:6578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115023.817508:0:6578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c924d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d17c7 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787115023.817537:0:6578:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a853610, blocks: 0x1 00010000:00010000:1.0:1787115023.817559:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=352s v=(0 0) 00010000:00010000:1.0:1787115023.817564:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787115023.817574:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c924d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17c7 expref: 11 pid: 6578 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.817603:0:6578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c924d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17c7 expref: 11 pid: 6578 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.817639:0:6578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a1c00, rc 0) 00000100:00100000:1.0:1787115023.817704:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+11:2364:x1873925602636800:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 236us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115023.817712:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 63 00000100:00100000:3.0:1787115023.824880:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115023.825255:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602637056 00000100:00100000:2.0:1787115023.825265:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602637056 00000100:00100000:2.0:1787115023.825352:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 226 00000100:00100000:2.0:1787115023.825363:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+66:11590:x1873925602637056:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787115023.825471:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+66:11590:x1873925602637056:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 Request processed in 110us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115023.825480:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 226 00000100:00100000:2.0:1787115023.829150:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115023.829297:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602637184 00000100:00100000:3.0:1787115023.829308:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602637184 00000100:00100000:3.0:1787115023.829370:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 64 00000100:00100000:3.0:1787115023.829380:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ee8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+11:11590:x1873925602637184:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787115023.829403:0:6576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115023.829424:0:6576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024bdce3b/0x194cd781e88c9254 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d17ce expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.829465:0:6576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c924d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17c7 expref: 12 pid: 6578 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.829476:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115023.829480:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115023.829486:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024bdce3b/0x194cd781e88c9254 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17ce expref: 12 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.829523:0:6576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c924d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17c7 expref: 12 pid: 6578 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.829550:0:6576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c924d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17c7 expref: 12 pid: 6578 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115023.829566:0:6576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6576:1873925624641024:192.168.202.10@tcp:104: 00000100:00100000:2.0:1787115023.832924:0:6576:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f0edc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787115023.839101:0:6576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6576:1873925624641024:192.168.202.10@tcp:104: 00010000:00010000:2.0:1787115023.839293:0:6576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000024bdce3b/0x194cd781e88c9254 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17ce expref: 12 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.839318:0:6576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041682400, rc 0) 00000100:00100000:2.0:1787115023.839385:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ee8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+12:11590:x1873925602637184:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 10006us (10281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115023.839395:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 64 00000100:00100000:0.0:1787115023.841828:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115023.841930:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602637312 00000100:00100000:1.0:1787115023.841941:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602637312 00010000:00010000:1.0:1787115023.841991:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c924d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17c7 expref: 12 pid: 6578 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115023.842037:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 79 00000100:00100000:1.0:1787115023.842047:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+12:2363:x1873925602637312:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787115023.842061:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787115023.842084:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c924d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17c7 expref: 12 pid: 6578 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.842097:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c924d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17c7 expref: 12 pid: 6578 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.842154:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a399c19/0x194cd781e88c924d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17c7 expref: 12 pid: 6578 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.842240:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787115023.842245:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787115023.842255:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000024bdce3b/0x194cd781e88c9254 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17ce expref: 11 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.842289:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024bdce3b/0x194cd781e88c9254 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17ce expref: 11 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.842327:0:5770:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000024bdce3b/0x194cd781e88c9254 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17ce expref: 11 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115023.842341:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5770:1873925624641152:192.168.202.10@tcp:105: 00000100:00100000:1.0:1787115023.842411:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042d2d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787115023.849423:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5770:1873925624641152:192.168.202.10@tcp:105: 00010000:00010000:1.0:1787115023.849455:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787115023.849518:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+11:2363:x1873925602637312:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 7471us (7709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115023.849529:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 79 00000100:00100000:0.0:1787115023.855362:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115023.855455:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602637440 00000100:00100000:1.0:1787115023.855466:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602637440 00002000:00100000:1.0:1787115023.855523:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8af07398b480 x1873925602637440/t0(0) o4->6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp:589/0 lens 504/0 e 0 to 0 dl 1787115034 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787115023.855535:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af07398b480 with x1873925602637440 ext(0->12) 00002000:00010000:1.0:1787115023.855541:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af07398b480 00000100:00100000:1.0:1787115023.855573:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00100000:1.0:1787115023.855592:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07398b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+11:2364:x1873925602637440:12345-192.168.202.10@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787115023.856444:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07398b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+13:2364:x1873925602637440:12345-192.168.202.10@tcp:4:lhsmtool_posix.0 Request processed in 859us (1087us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1787115023.856463:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6 00002000:00100000:1.0:1787115023.856473:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8af07398b480 x1873925602637440/t4294967320(0) o4->6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp:589/0 lens 504/448 e 0 to 0 dl 1787115034 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787115023.856481:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af07398b480 with x1873925602637440 ext(0->12) 00002000:00010000:1.0:1787115023.856486:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af07398b480 00000100:00100000:0.0:1787115023.872055:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115023.872471:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602637568 00000100:00100000:2.0:1787115023.872484:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602637568 00000100:00100000:2.0:1787115023.872559:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 227 00000100:00100000:2.0:1787115023.872572:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+66:11590:x1873925602637568:12345-192.168.202.10@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787115023.952625:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967498 is committed 00000004:00080000:2.0:1787115023.952655:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787115023.952673:0:5807:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8af045be1480 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1787115023.952678:0:5807:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af06f3ddb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8af045be1c00 00000020:00080000:2.0:1787115023.952681:0:5807:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af06f3dd300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af07f6b1400 00000100:00100000:1.0:1787115023.953027:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+59:11590:x1873925602637568:12345-192.168.202.10@tcp:44:lhsmtool_posix.0 Request processed in 80449us (80976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115023.953040:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 227 00000100:00100000:3.0:1787115023.954402:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787115023.954428:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624641280:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787115023.954514:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787115023.954848:0:5807:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1787115023.954956:0:5807:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8af050797480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1787115023.955091:0:5807:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af058e26900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8af050797a80 00000020:00080000:2.0:1787115023.955097:0:5807:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af058e26700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af06eeec000 00000001:00080000:2.0:1787115023.955146:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:2.0:1787115023.955152:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000001:00080000:2.0:1787115023.955191:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1787115023.955212:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1787115023.955235:0:5818:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1787115023.955788:0:5818:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787115023.956044:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624641536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787115023.956147:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115023.956208:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787115023.956215:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06ee8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624641408:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787115023.956239:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115023.956269:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624641280 00000100:00100000:2.0:1787115023.956824:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624641280 00000100:00100000:2.0:1787115023.956928:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624641536 00000100:00100000:2.0:1787115023.956932:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624641536 00000100:00100000:2.0:1787115023.956957:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624641408 00000100:00100000:2.0:1787115023.957214:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624641408 00000100:00100000:2.0:1787115023.957510:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787115023.957523:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1873925624641280:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787115023.957753:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787115023.957765:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1873925624641536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787115023.958044:0:6577:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787115023.958048:0:6577:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787115024 00002000:00010000:1.0:1787115023.958050:0:6577:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787115023.958052:0:6577:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787115024 -> 1787115024 00002000:00010000:1.0:1787115023.958055:0:6577:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787115023.958164:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3309:x1873925624641536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 400us (2015us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1787115023.958171:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787115023.958192:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787115023.958200:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1873925624641408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787115023.958220:0:6577:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1787115023.958256:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d215abca/0x194cd781e88c925b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.958697:0:6577:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061e725fe/0x194cd781e88c901d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d172d expref: 12 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.958768:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787115023.958774:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787115023.958779:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d215abca/0x194cd781e88c925b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.958837:0:6577:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061e725fe/0x194cd781e88c901d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d172d expref: 12 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.958856:0:6577:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061e725fe/0x194cd781e88c901d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d172d expref: 12 pid: 11535 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115023.958873:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6577:1873925624641664:192.168.202.10@tcp:104: 00002000:00080000:2.0:1787115023.959124:0:6578:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1787115023.959163:0:6578:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a85360f, atime: 0x6a85360f, ctime: 0x6a85360f, blocks: 0x1 00010000:00010000:2.0:1787115023.959171:0:6578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd8e1c5a/0x194cd781e88c9262 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.959185:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=352s v=(0 0) 00010000:00010000:2.0:1787115023.959188:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115023.959194:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd8e1c5a/0x194cd781e88c9262 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.959213:0:6578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd8e1c5a/0x194cd781e88c9262 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787115023.959400:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787115023.959418:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787115023.959482:0:6578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd8e1c5a/0x194cd781e88c9262 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.959492:0:6578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd8e1c5a/0x194cd781e88c9262 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.959524:0:6578:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787115023.959856:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042d2de40 going to sleep for 11 seconds 00010000:00010000:0.0:1787115023.959937:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787115023.959944:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd8e1c5a/0x194cd781e88c9262 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.959955:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2800 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787115023.959959:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd8e1c5a/0x194cd781e88c9262 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.959986:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd8e1c5a/0x194cd781e88c9262 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.960008:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd8e1c5a/0x194cd781e88c9262 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.960018:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd8e1c5a/0x194cd781e88c9262 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115023.960046:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115023.960048:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115023.960050:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787115023.961441:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8af0739ab800/2, rc 0, transno 4294967321 00000100:00100000:0.0:1787115023.961456:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624641536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787115023.966699:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3306:x1873925624641280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9167us (12173us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787115023.966818:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:1.0:1787115023.968236:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8af07f7e7b80/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787115023.968251:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624641280:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787115023.968471:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6577:1873925624641664:192.168.202.10@tcp:104: 00010000:00010000:2.0:1787115023.968505:0:6577:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d215abca/0x194cd781e88c925b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115023.972446:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115023.973240:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602637696 00000100:00100000:2.0:1787115023.973259:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602637696 00010000:00010000:2.0:1787115023.973335:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061e725fe/0x194cd781e88c901d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d172d expref: 13 pid: 11535 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115023.973413:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 80 00000100:00100000:2.0:1787115023.973427:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+13:2363:x1873925602637696:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115023.973458:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115023.973467:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061e725fe/0x194cd781e88c901d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d172d expref: 13 pid: 11535 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.973486:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061e725fe/0x194cd781e88c901d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d172d expref: 13 pid: 11535 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.973525:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061e725fe/0x194cd781e88c901d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d172d expref: 13 pid: 11535 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.973552:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787115023.973557:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787115023.973564:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d215abca/0x194cd781e88c925b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115023.973577:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d215abca/0x194cd781e88c925b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115023.973877:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1787115023.974192:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115023.974271:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+12:2363:x1873925602637696:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 846us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115023.974293:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 80 00000100:00100000:3.0:1787115023.977550:0:11900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602637824 00000100:00100000:3.0:1787115023.977575:0:11900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602637824 00000100:00100000:3.0:1787115023.977985:0:11900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 68 00000100:00100000:3.0:1787115023.977999:0:11900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6aef9ffe-3b7b-498c-9a5a-a012c6970297+12:2363:x1873925602637824:12345-192.168.202.10@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1787115023.978194:0:6577:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d215abca/0x194cd781e88c925b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.978211:0:6577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d215abca/0x194cd781e88c925b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.978223:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d215abca/0x194cd781e88c925b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.978243:0:6577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d215abca/0x194cd781e88c925b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115023.978261:0:6577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787115023.979166:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787115023.979181:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d215abca/0x194cd781e88c925b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.979195:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1800 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:1.0:1787115023.979201:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d215abca/0x194cd781e88c925b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.979242:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d215abca/0x194cd781e88c925b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.979284:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d215abca/0x194cd781e88c925b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.979294:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d215abca/0x194cd781e88c925b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115023.979333:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115023.979336:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115023.979338:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787115023.982057:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3309:x1873925624641408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23843us (25801us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787115023.982076:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:2.0:1787115023.982935:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8af06ee8f100/2, rc 0, transno 4294967322 00000100:00100000:2.0:1787115023.982951:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06ee8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624641408:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787115024.029935:0:11900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6aef9ffe-3b7b-498c-9a5a-a012c6970297+12:2363:x1873925602637824:12345-192.168.202.10@tcp:16:lhsmtool_posix.0 Request processed in 51925us (56056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115024.029951:0:11900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 68 00000001:00080000:0.0:1787115024.030095:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:0.0:1787115024.030140:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:1.0:1787115024.037289:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115024.037448:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602638080 00000100:00100000:3.0:1787115024.037462:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602638080 00000100:00100000:3.0:1787115024.037604:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 228 00000100:00100000:3.0:1787115024.037616:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+20:11590:x1873925602638080:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787115024.037694:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787115024.037736:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0800/0x194cd781e88c9246 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17c0 expref: 20 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.037762:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8af051ecbe00) 00010000:00010000:3.0:1787115024.037768:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787115024.037818:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c9269 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.037835:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c9269 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.037845:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c9269 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787115024.038302:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f0e16406 reply state 000000000e8320f7 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c9269 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115024.038315:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787115024.038439:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+21:11590:x1873925602638080:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 Request processed in 825us (1173us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1787115024.038448:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 228 00000100:00080000:0.0:1787115024.040940:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787115024.046193:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115024.046291:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602638208 00000100:00100000:3.0:1787115024.046302:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602638208 00000100:00100000:3.0:1787115024.046351:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 69 00000100:00100000:3.0:1787115024.046362:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2364:x1873925602638208:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787115024.046587:0:6578:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787115024.046591:0:6578:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787115024 -> 1787115024 00002000:00010000:3.0:1787115024.046593:0:6578:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787115023 00002000:00010000:3.0:1787115024.046596:0:6578:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787115024 -> 1787115024 00002000:00010000:3.0:1787115024.046598:0:6578:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787115024.046662:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2364:x1873925602638208:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 Request processed in 302us (483us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787115024.046670:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 69 00010000:00010000:2.0:1787115024.048355:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c9269 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.048372:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c9269 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.048380:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c9269 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.048386:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041683000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115024.048390:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c9269 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.048399:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c9269 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.048417:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8af051ecbe00) 00010000:00010000:2.0:1787115024.048421:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115024.048425:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c9269 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.048450:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c9269 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115024.051398:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115024.051546:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602638464 00000100:00100000:1.0:1787115024.051556:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602638464 00000100:00100000:1.0:1787115024.051622:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 229 00000100:00100000:1.0:1787115024.051634:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+20:11590:x1873925602638464:12345-192.168.202.10@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787115024.051713:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9270 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.051733:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c922a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17b2 expref: 20 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.051743:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9270 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.051801:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c922a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17b2 expref: 20 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.051826:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c922a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17b2 expref: 20 pid: 7216 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115024.051842:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1873925624641792:192.168.202.10@tcp:104: 00000100:00100000:1.0:1787115024.051945:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06c1c4600 going to sleep for 11 seconds 00000100:00100000:1.0:1787115024.057150:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115024.057313:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5786:1873925624641792:192.168.202.10@tcp:104: 00010000:00010000:2.0:1787115024.057341:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9270 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115024.057451:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602638592 00000100:00100000:3.0:1787115024.057459:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602638592 00010000:00010000:3.0:1787115024.057503:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c922a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17b2 expref: 21 pid: 7216 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115024.057544:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 81 00000100:00100000:3.0:1787115024.057554:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f105500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+21:2364:x1873925602638592:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787115024.057568:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787115024.057575:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c922a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17b2 expref: 21 pid: 7216 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.057599:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c922a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17b2 expref: 21 pid: 7216 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.057619:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c922a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17b2 expref: 21 pid: 7216 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.057644:0:6592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8af051ecbe00) 00010000:00010000:3.0:1787115024.057650:0:6592:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9270 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.057659:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9270 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.057667:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9270 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.057697:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787115024.057767:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f105500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+20:2364:x1873925602638592:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 214us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115024.057775:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 81 00010000:00010000:2.0:1787115024.058192:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9270 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.058202:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9270 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.058235:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9270 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.058243:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9270 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.058249:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9270 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.058255:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115024.058259:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9270 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.058266:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9270 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.058276:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8af051ecbe00) 00010000:00010000:2.0:1787115024.058286:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787115024.058290:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9270 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.058296:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9270 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115024.058338:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+19:11590:x1873925602638464:12345-192.168.202.10@tcp:55:lhsmtool_posix.0 Request processed in 6706us (6953us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787115024.058346:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 229 00000100:00100000:0.0:1787115024.063221:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115024.063280:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602638720 00000100:00100000:2.0:1787115024.063292:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602638720 00000100:00100000:2.0:1787115024.063375:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 70 00000100:00100000:2.0:1787115024.063388:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2362:x1873925602638720:12345-192.168.202.10@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787115024.063448:0:6576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d669aca2/0x194cd781e88c9277 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.063477:0:6576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000024bdce3b/0x194cd781e88c9254 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17ce expref: 8 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.063486:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787115024.063491:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787115024.063496:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d669aca2/0x194cd781e88c9277 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.063533:0:6576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000024bdce3b/0x194cd781e88c9254 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17ce expref: 8 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.063574:0:6576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000024bdce3b/0x194cd781e88c9254 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17ce expref: 8 pid: 6576 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115024.063592:0:6576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6576:1873925624641920:192.168.202.10@tcp:104: 00000100:00100000:2.0:1787115024.063746:0:6576:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5fa780 going to sleep for 11 seconds 00000100:00100000:2.0:1787115024.071515:0:6576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6576:1873925624641920:192.168.202.10@tcp:104: 00010000:00010000:2.0:1787115024.071559:0:6576:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d669aca2/0x194cd781e88c9277 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115024.074208:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115024.074432:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602638848 00000100:00100000:2.0:1787115024.074441:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602638848 00010000:00010000:2.0:1787115024.074484:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000024bdce3b/0x194cd781e88c9254 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17ce expref: 9 pid: 6576 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115024.074527:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 82 00000100:00100000:2.0:1787115024.074536:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073988e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+9:2361:x1873925602638848:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115024.074553:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115024.074575:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000024bdce3b/0x194cd781e88c9254 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17ce expref: 9 pid: 6576 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.074589:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000024bdce3b/0x194cd781e88c9254 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17ce expref: 9 pid: 6576 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.074615:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024bdce3b/0x194cd781e88c9254 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17ce expref: 9 pid: 6576 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.074645:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787115024.074650:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787115024.074657:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d669aca2/0x194cd781e88c9277 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.074668:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d669aca2/0x194cd781e88c9277 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.074712:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115024.074769:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073988e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2361:x1873925602638848:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 234us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115024.074777:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 82 00010000:00010000:3.0:1787115024.075618:0:6576:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d669aca2/0x194cd781e88c9277 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.075635:0:6576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d669aca2/0x194cd781e88c9277 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.075674:0:6576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d669aca2/0x194cd781e88c9277 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.075684:0:6576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d669aca2/0x194cd781e88c9277 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.075692:0:6576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d669aca2/0x194cd781e88c9277 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.075712:0:6576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2a00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:3.0:1787115024.075716:0:6576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d669aca2/0x194cd781e88c9277 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.075727:0:6576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d669aca2/0x194cd781e88c9277 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.075744:0:6576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d669aca2/0x194cd781e88c9277 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.075752:0:6576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d669aca2/0x194cd781e88c9277 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115024.075853:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2362:x1873925602638720:12345-192.168.202.10@tcp:1:lhsmtool_posix.0 Request processed in 12465us (12644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115024.075865:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 70 00000100:00100000:0.0:1787115024.084981:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115024.085332:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602639104 00000100:00100000:3.0:1787115024.085345:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602639104 00000100:00100000:3.0:1787115024.085413:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 230 00000100:00100000:3.0:1787115024.085424:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+19:11590:x1873925602639104:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787115024.085521:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c927e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.085542:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c927e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.085576:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c927e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.085821:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c9285 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.085832:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9238 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17b9 expref: 20 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.085840:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c9285 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.085876:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9238 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17b9 expref: 20 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.085891:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9238 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17b9 expref: 20 pid: 7216 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115024.085907:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b6a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1873925624642048:192.168.202.10@tcp:104: 00000100:00100000:3.0:1787115024.086004:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f0ed240 going to sleep for 11 seconds 00000100:00100000:3.0:1787115024.087776:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b6a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1873925624642048:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787115024.087820:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c9285 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115024.089952:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115024.090070:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602639232 00000100:00100000:3.0:1787115024.090084:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602639232 00010000:00010000:3.0:1787115024.090449:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9238 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17b9 expref: 21 pid: 7216 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115024.090529:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 83 00000100:00100000:3.0:1787115024.090540:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073989f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+21:2363:x1873925602639232:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787115024.090559:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787115024.090567:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9238 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17b9 expref: 21 pid: 7216 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.090581:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9238 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17b9 expref: 21 pid: 7216 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.090605:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9238 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17b9 expref: 21 pid: 7216 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.090622:0:6592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8af051ecbe00) 00010000:00010000:3.0:1787115024.090628:0:6592:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c9285 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.090639:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c9285 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.090647:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c9285 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115024.090733:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787115024.090789:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073989f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+20:2363:x1873925602639232:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 250us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115024.090796:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 83 00010000:00010000:2.0:1787115024.092990:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c9285 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.093008:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c9285 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787115024.093490:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1787115024.093654:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1787115024.093708:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1787115024.093820:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5785:1873925624642176:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787115024.094315:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115024.094395:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af042d2de40 going to sleep for 11 seconds 00000100:00100000:3.0:1787115024.097756:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624642176 00000100:00100000:3.0:1787115024.097798:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624642176 00000100:00100000:2.0:1787115024.097999:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787115024.098012:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5785:x1873925624642176:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787115024.098200:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5785:x1873925624642176:12345-0@lo:1000:mdt00_000.0 Request processed in 189us (3884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115024.098208:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787115024.098598:0:5785:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1787115024.098607:0:5785:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1787115024.098633:0:5785:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8af0739ab800, transno 4294967321 00000100:00100000:0.0:1787115024.098657:0:5785:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8af06ee8f100 x1873925624641408/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787115039 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787115024.098672:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5785:1873925624642176:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787115024.101696:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1787115024.101798:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073988380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5785:1873925624642304:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787115024.103245:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115024.103532:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af073aeb180 going to sleep for 11 seconds 00000100:00100000:2.0:1787115024.103822:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624642304 00000100:00100000:2.0:1787115024.103834:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624642304 00000100:00100000:2.0:1787115024.103910:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787115024.103919:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5785:x1873925624642304:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787115024.104555:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5785:x1873925624642304:12345-0@lo:1000:mdt00_000.0 Request processed in 635us (1311us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787115024.104564:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787115024.106515:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073988380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5785:1873925624642304:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787115024.106574:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c9285 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.106588:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c9285 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.106595:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c9285 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.106602:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115024.106607:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c9285 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.106615:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c9285 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.106632:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8af051ecbe00) 00010000:00010000:1.0:1787115024.106655:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787115024.106661:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c9285 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.106667:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682200/0x194cd781e88c9285 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.106703:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c91c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.106709:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c91c8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.106715:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c91c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.106720:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115024.106723:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c91c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.106729:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c91c8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.106737:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:1.0:1787115024.106739:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787115024.106746:0:5785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c91cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d179d expref: 23 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.106756:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c91cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d179d expref: 23 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.106766:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c91cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d179d expref: 23 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.106827:0:5785:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c91cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d179d expref: 23 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115024.106878:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f104a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1873925624642432:192.168.202.10@tcp:105: 00000100:00100000:1.0:1787115024.107576:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06c1c4480 going to sleep for 11 seconds 00000100:00100000:0.0:1787115024.110002:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115024.110140:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602639360 00000100:00100000:3.0:1787115024.110151:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602639360 00000100:00100000:3.0:1787115024.110214:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 61 00000100:00100000:3.0:1787115024.110224:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+24:11589:x1873925602639360:12345-192.168.202.10@tcp:49:lfs.0 00000100:00100000:3.0:1787115024.110379:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+24:11589:x1873925602639360:12345-192.168.202.10@tcp:49:lfs.0 Request processed in 156us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115024.110386:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 61 00000100:00100000:1.0:1787115024.110951:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f104a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5785:1873925624642432:192.168.202.10@tcp:105: 00010000:00010000:1.0:1787115024.110990:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c91c8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.111002:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c91c8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.111041:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c928c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.111066:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c928c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.111081:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c928c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.111091:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c928c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.111097:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c928c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.111103:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c928c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.111153:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115024.111158:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c928c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.111165:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c928c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.111179:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:1.0:1787115024.111182:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787115024.111185:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c928c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.111191:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c928c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.111201:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c927e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.111207:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c927e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.111212:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c927e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.111217:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041683000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115024.111219:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c927e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.111224:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c927e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.111243:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:1.0:1787115024.111245:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787115024.111248:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c927e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.111253:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041683000/0x194cd781e88c927e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115024.111494:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+23:11590:x1873925602639104:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 Request processed in 26070us (26524us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1787115024.111505:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 230 00000020:00080000:1.0:1787115024.111509:0:5785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787115024.112556:0:11519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787115024.112564:0:11519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787115024.113052:0:11519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787115024.113145:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787115024.114154:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115024.114308:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602639616 00000100:00100000:2.0:1787115024.114318:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602639616 00000100:00100000:2.0:1787115024.114377:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 231 00000100:00100000:2.0:1787115024.114387:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+23:11589:x1873925602639616:12345-192.168.202.10@tcp:58:lfs.0 00000040:00080000:2.0:1787115024.114760:0:7216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1787115024.114861:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+23:11589:x1873925602639616:12345-192.168.202.10@tcp:58:lfs.0 Request processed in 475us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115024.115604:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115024.115796:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 231 00000100:00100000:0.0:1787115024.115966:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602639872 00000100:00100000:0.0:1787115024.115975:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602639872 00000100:00100000:0.0:1787115024.116022:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 62 00000100:00100000:0.0:1787115024.116031:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af066349c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+23:11590:x1873925602639872:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787115024.117638:0:5789:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787115024.117817:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1787115024.117907:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9293 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.117925:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9293 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.117937:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9293 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.117946:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9293 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.117953:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9293 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.117960:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9293 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.117993:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787115024.118189:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af066349c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+25:11590:x1873925602639872:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 Request processed in 2153us (2581us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1787115024.118198:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 62 00000020:00080000:1.0:1787115024.118203:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787115024.118296:0:8290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115024.118303:0:8290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9293 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.118310:0:8290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1a00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115024.118320:0:8290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9293 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.118328:0:8290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9293 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.118341:0:8290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8af0510d6000) 00010000:00010000:2.0:1787115024.118344:0:8290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787115024.118349:0:8290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9293 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.118354:0:8290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c9293 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.118370:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115024.118372:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115024.118373:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787115024.160726:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115024.160822:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602640000 00000100:00100000:1.0:1787115024.160837:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602640000 00000100:00100000:1.0:1787115024.160920:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 232 00000100:00100000:1.0:1787115024.160933:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+25:11593:x1873925602640000:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1787115024.160961:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115024.160987:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c929a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d17d5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.161606:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c92a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.161625:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c92a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.161638:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c92a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.161655:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c92a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.161661:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c92a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.161667:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c92a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.162211:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c92af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.162225:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c91ba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1796 expref: 26 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.162235:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c92af lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.162276:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c91ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1796 expref: 26 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.162293:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c91ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1796 expref: 26 pid: 5785 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115024.162310:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f104a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624642560:192.168.202.10@tcp:104: 00000100:00100000:1.0:1787115024.162416:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050797540 going to sleep for 11 seconds 00000100:00100000:2.0:1787115024.167357:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f104a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5787:1873925624642560:192.168.202.10@tcp:104: 00010000:00010000:2.0:1787115024.167390:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c92af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115024.167407:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115024.167558:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602640256 00000100:00100000:0.0:1787115024.167567:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602640256 00000100:00100000:0.0:1787115024.167640:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 63 00000100:00100000:0.0:1787115024.167652:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+27:5576:x1873925602640256:12345-192.168.202.10@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787115024.167900:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+28:5576:x1873925602640256:12345-192.168.202.10@tcp:35:ldlm_bl.0 Request processed in 249us (493us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787115024.167908:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 63 00000100:00100000:3.0:1787115024.170655:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115024.170770:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602640384 00000100:00100000:2.0:1787115024.170780:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602640384 00010000:00010000:2.0:1787115024.170831:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c91ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1796 expref: 28 pid: 5785 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115024.170878:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 84 00000100:00100000:2.0:1787115024.170890:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+28:2363:x1873925602640384:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115024.170906:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115024.170913:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c91ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1796 expref: 28 pid: 5785 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.170942:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c91ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1796 expref: 28 pid: 5785 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.170982:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af041682c00/0x194cd781e88c91ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1796 expref: 28 pid: 5785 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.170999:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:2.0:1787115024.171005:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c92af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.171014:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c92af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.171022:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c92af lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115024.171057:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115024.171152:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+27:2363:x1873925602640384:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 264us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115024.171159:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 84 00010000:00010000:1.0:1787115024.172483:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c92af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.172499:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c92af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787115024.172558:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787115024.172563:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787115024.172586:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c92af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.172628:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c92af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.172641:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c92a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.172648:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c92a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.172656:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c92a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.172664:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1800 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115024.172668:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c92a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.172676:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c92a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.172688:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:1.0:1787115024.172692:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787115024.172697:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c92a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.172703:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1800/0x194cd781e88c92a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.172721:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c92a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.172728:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c92a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.172740:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c92a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.172746:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115024.172750:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c92a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.172756:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c92a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.172765:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8af0510d6800) 00010000:00010000:1.0:1787115024.172767:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787115024.172770:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c92a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.172776:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1c00/0x194cd781e88c92a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.172839:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c929a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17d5 expref: 27 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.172855:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c92af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17d5 expref: 26 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115024.172862:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:1.0:1787115024.172864:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787115024.172867:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0e00, rc 0) 00000100:00100000:1.0:1787115024.172920:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+26:11593:x1873925602640000:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 11990us (12205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115024.172937:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 232 00010000:00010000:1.0:1787115024.709462:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787115024.778143:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115024.778178:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115024.778289:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602640640 00000100:00100000:1.0:1787115024.778297:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602640640 00000100:00100000:1.0:1787115024.778352:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 170 00000100:00100000:1.0:1787115024.778361:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+26:2361:x1873925602640640:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787115024.778618:0:11900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602640896 00000100:00100000:0.0:1787115024.778634:0:11900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602640896 00000100:00100000:0.0:1787115024.778662:0:11900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 78 00000100:00100000:0.0:1787115024.778669:0:11900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2361:x1873925602640896:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787115024.778777:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+26:2361:x1873925602640640:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 417us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115024.778786:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 170 00000100:00100000:2.0:1787115024.783890:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115024.783956:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115024.783998:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115024.784026:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602641024 00000100:00100000:2.0:1787115024.784036:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602641024 00000100:00100000:1.0:1787115024.784184:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602640512 00000100:00100000:1.0:1787115024.784189:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602640512 00000100:00100000:1.0:1787115024.784251:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 299 00000100:00100000:1.0:1787115024.784262:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2361:x1873925602640512:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787115024.784333:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2361:x1873925602640512:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 72us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115024.784341:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 299 00000100:00100000:2.0:1787115024.784556:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 171 00000100:00100000:2.0:1787115024.784577:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067b55fc-03d7-46d6-801a-48936d919d16+5:2361:x1873925602641024:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787115024.784615:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067b55fc-03d7-46d6-801a-48936d919d16+5:2361:x1873925602641024:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 39us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115024.784622:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 171 00000100:00100000:0.0:1787115024.784721:0:11535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602640768 00000100:00100000:0.0:1787115024.784725:0:11535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602640768 00000100:00100000:0.0:1787115024.784757:0:11535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 79 00000100:00100000:0.0:1787115024.784765:0:11535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2361:x1873925602640768:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787115024.784792:0:11535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2361:x1873925602640768:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 28us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115024.784810:0:11535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 79 00000100:00100000:0.0:1787115024.784851:0:11900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2361:x1873925602640896:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 6181us (6670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115024.784858:0:11900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 78 00000100:00080000:1.0:1787115024.785030:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787115024.785035:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1787115025.163667:0:11519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787115025.163678:0:11519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787115025.163741:0:11519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787115025.163748:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787115025.163906:0:11519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b6a4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11519:1873925624642688:192.168.202.10@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787115025.164006:0:11519:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f0ed6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787115025.170227:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115025.170292:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602641152 00000100:00100000:0.0:1787115025.170302:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602641152 00000100:00100000:0.0:1787115025.170361:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 233 00000100:00100000:0.0:1787115025.170372:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+27:11604:x1873925602641152:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787115025.170409:0:5786:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787115025.170446:0:11519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b6a4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11519:1873925624642688:192.168.202.10@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787115025.170527:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+26:11604:x1873925602641152:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 Request processed in 156us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115025.170535:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 233 00000100:00100000:0.0:1787115025.181202:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115025.181374:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602641408 00000100:00100000:2.0:1787115025.181386:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602641408 00000100:00100000:2.0:1787115025.181454:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 234 00000100:00100000:2.0:1787115025.181465:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af051363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+26:11604:x1873925602641408:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787115025.181498:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115025.181523:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c92b6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d17dc expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115025.181659:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c92bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115025.181675:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c92bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115025.181690:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c92bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115025.181701:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787115025.181849:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c92b6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17dc expref: 29 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115025.181866:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c92bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17dc expref: 28 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115025.181887:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:2.0:1787115025.181890:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787115025.181895:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3c00, rc 0) 00000100:00100000:2.0:1787115025.181967:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af051363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+28:11604:x1873925602641408:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 503us (776us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787115025.181975:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 234 00000040:00080000:1.0:1787115025.182704:0:12346:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787115025.182710:0:12346:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787115025.182847:0:12346:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787115025.182855:0:12346:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787115025.188036:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115025.188143:0:7216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602641664 00000100:00100000:2.0:1787115025.188156:0:7216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602641664 00000100:00100000:2.0:1787115025.188231:0:7216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 235 00000100:00100000:2.0:1787115025.188241:0:7216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+28:11604:x1873925602641664:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787115025.188336:0:7216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c92cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115025.188354:0:7216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c92cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115025.188366:0:7216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c92cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115025.189025:0:7216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c92cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115025.189035:0:7216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c92cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115025.189042:0:7216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c92cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115025.189066:0:7216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2800 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115025.189071:0:7216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c92cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115025.189079:0:7216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c92cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115025.189093:0:7216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:2.0:1787115025.189096:0:7216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787115025.189101:0:7216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c92cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115025.189296:0:7216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c92cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115025.189532:0:7216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+29:11604:x1873925602641664:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 Request processed in 1290us (1505us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1787115025.189543:0:7216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 235 00000100:00100000:1.0:1787115025.190444:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115025.191093:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602641792 00000100:00100000:2.0:1787115025.191102:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602641792 00000100:00100000:2.0:1787115025.191178:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17 00000100:00100000:2.0:1787115025.191198:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f106300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+29:2364:x1873925602641792:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115025.191214:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115025.191242:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3c00/0x194cd781e88c92bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17dc expref: 29 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115025.191389:0:6592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:2.0:1787115025.191395:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115025.191453:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f106300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6aef9ffe-3b7b-498c-9a5a-a012c6970297+28:2364:x1873925602641792:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 266us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115025.191461:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17 00000040:00080000:0.0:1787115025.193571:0:11519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787115025.193636:0:11519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1787115025.194084:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000040:00080000:0.0:1787115025.194635:0:11519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787115025.194644:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787115025.194878:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602642048 00000100:00100000:2.0:1787115025.194888:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602642048 00000100:00100000:2.0:1787115025.194981:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 64 00000100:00100000:2.0:1787115025.194991:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f105180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+28:11604:x1873925602642048:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787115025.195403:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f105180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+29:11604:x1873925602642048:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 Request processed in 412us (1321us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787115025.195413:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 64 00000100:00100000:2.0:1787115025.286390:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787115025.286415:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b6a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624642816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787115025.286499:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115025.286812:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624643328:0@lo:400:kworker.0 00000100:00100000:2.0:1787115025.286841:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115025.286867:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787115025.286873:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624642944:0@lo:400:kworker.0 00000100:00100000:2.0:1787115025.286901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115025.286922:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624643456:0@lo:400:kworker.0 00000100:00100000:2.0:1787115025.286945:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115025.286970:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624643072:0@lo:400:kworker.0 00000100:00100000:2.0:1787115025.286992:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115025.287010:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787115025.287015:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624643200:0@lo:400:kworker.0 00000100:00100000:2.0:1787115025.287038:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115025.287079:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624643328 00000100:00100000:2.0:1787115025.287087:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624643328 00000100:00100000:2.0:1787115025.287171:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624643072 00000100:00100000:2.0:1787115025.287175:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624643072 00000100:00100000:2.0:1787115025.287209:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624643200 00000100:00100000:2.0:1787115025.287213:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624643200 00000100:00100000:2.0:1787115025.287235:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787115025.287251:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624643328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115025.287306:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624643328:12345-0@lo:400:kworker.0 Request processed in 63us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115025.287314:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787115025.287332:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787115025.287337:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624643072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115025.287368:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624643072:12345-0@lo:400:kworker.0 Request processed in 30us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115025.287374:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787115025.287385:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787115025.287391:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624643200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115025.287416:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624643200:12345-0@lo:400:kworker.0 Request processed in 25us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115025.287423:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787115025.287440:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624642944 00000100:00100000:2.0:1787115025.287443:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624642944 00000100:00100000:2.0:1787115025.287467:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787115025.287473:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624642944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115025.287627:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3306:x1873925624642944:12345-0@lo:400:kworker.0 Request processed in 153us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115025.287642:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787115025.287670:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624643456 00000100:00100000:2.0:1787115025.287674:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624643456 00000100:00100000:2.0:1787115025.287704:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787115025.287710:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1873925624643456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115025.287739:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1873925624643456:12345-0@lo:400:kworker.0 Request processed in 29us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115025.287744:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1787115025.287764:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787115025.287768:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787115025.287815:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624643200:0@lo:400:kworker.0 00000100:00100000:2.0:1787115025.287827:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624643072:0@lo:400:kworker.0 00000100:00100000:2.0:1787115025.287855:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6bfcc0b7-8035-40e1-91c8-e687d170788c:3306:1873925624642944:0@lo:400:kworker.0 00000100:00100000:2.0:1787115025.287866:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624643456:0@lo:400:kworker.0 00000100:00100000:2.0:1787115025.287875:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624643328:0@lo:400:kworker.0 00000100:00100000:3.0:1787115025.291652:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624642816 00000100:00100000:3.0:1787115025.291670:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624642816 00000100:00100000:3.0:1787115025.291738:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787115025.291749:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3307:x1873925624642816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787115025.291793:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787115025.291888:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3307:x1873925624642816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (5389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115025.291895:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787115025.291969:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b6a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624642816:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787115025.292303:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787115025.734484:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787115025.797618:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787115025.797642:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624643584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787115025.797738:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115025.797879:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624643584 00000100:00100000:0.0:1787115025.797889:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624643584 00000100:00100000:0.0:1787115025.797960:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787115025.797970:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1873925624643584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787115025.798010:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787115025.798076:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1873925624643584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115025.798085:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787115025.798267:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624643584:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787115025.881948:0:6604:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1787115025.881987:0:6604:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000040:00080000:0.0:1787115026.245616:0:11519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787115026.245628:0:11519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787115026.245666:0:11519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787115026.245675:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787115026.757366:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787115027.300138:0:12399:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787115027.300151:0:12399:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787115027.300205:0:12399:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787115027.300210:0:12399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787115027.542970:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115027.543063:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602642304 00000100:00100000:2.0:1787115027.543095:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602642304 00000100:00080000:1.0:1787115027.543206:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787115027.543296:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 236 00000100:00100000:2.0:1787115027.543322:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+29:11625:x1873925602642304:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1787115027.543373:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115027.543463:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c92d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d17e3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115027.543567:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c92d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115027.543582:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c92d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115027.543597:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c92d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115027.543609:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787115027.543816:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2800/0x194cd781e88c92d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17e3 expref: 32 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115027.543833:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c92d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17e3 expref: 31 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115027.543841:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:2.0:1787115027.543844:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787115027.543847:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2400, rc 0) 00000100:00100000:2.0:1787115027.543909:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+31:11625:x1873925602642304:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 590us (947us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787115027.543917:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 236 00000100:00100000:3.0:1787115027.548364:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115027.548449:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602642432 00000100:00100000:2.0:1787115027.548474:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602642432 00000100:00100000:2.0:1787115027.548572:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 237 00000100:00100000:2.0:1787115027.548592:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+31:11625:x1873925602642432:12345-192.168.202.10@tcp:54:lfs.0 00010000:00010000:2.0:1787115027.549100:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c92e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115027.549631:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c92e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115027.549667:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c92e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115027.549833:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c92e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115027.549841:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c92e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115027.549847:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c92e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115027.549852:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115027.549857:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c92e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115027.549900:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c92e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115027.549913:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:2.0:1787115027.549927:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787115027.549932:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c92e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115027.549938:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2e00/0x194cd781e88c92e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115027.550314:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+31:11625:x1873925602642432:12345-192.168.202.10@tcp:54:lfs.0 Request processed in 1717us (1941us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115027.550326:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 237 00000100:00100000:1.0:1787115027.762973:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115027.765760:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602642560 00000100:00100000:0.0:1787115027.765799:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602642560 00000100:00100000:0.0:1787115027.765904:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 71 00000100:00100000:0.0:1787115027.765917:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f106d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2363:x1873925602642560:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:0.0:1787115027.765964:0:6578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115027.766003:0:6578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c92ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d17ea expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787115027.766049:0:6578:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a853610, atime: 0x6a85360f, ctime: 0x6a853610, blocks: 0xb 00010000:00010000:0.0:1787115027.766102:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=356s v=(0 0) 00010000:00010000:0.0:1787115027.766144:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787115027.766179:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c92ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17ea expref: 8 pid: 6578 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115027.766211:0:6578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c92ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17ea expref: 8 pid: 6578 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115027.766226:0:6578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030a00, rc 0) 00000100:00100000:0.0:1787115027.766373:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f106d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2363:x1873925602642560:12345-192.168.202.10@tcp:101:cat.0 Request processed in 458us (3410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115027.766392:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 71 00000100:00080000:0.0:1787115027.766442:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787115027.780018:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115027.780142:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602642688 00000100:00100000:3.0:1787115027.780154:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602642688 00002000:00100000:3.0:1787115027.780229:0:6583:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8af07b6a7800 x1873925602642688/t0(0) o3->6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp:593/0 lens 488/0 e 0 to 0 dl 1787115038 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787115027.780240:0:6583:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af07b6a7800 with x1873925602642688 ext(0->4095) 00002000:00010000:3.0:1787115027.780246:0:6583:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af07b6a7800 00000100:00100000:3.0:1787115027.780317:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:3.0:1787115027.780327:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2364:x1873925602642688:12345-192.168.202.10@tcp:3:cat.0 00000100:00100000:3.0:1787115027.780698:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+8:2364:x1873925602642688:12345-192.168.202.10@tcp:3:cat.0 Request processed in 360us (691us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787115027.780706:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7 00002000:00100000:3.0:1787115027.780724:0:6583:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8af07b6a7800 x1873925602642688/t0(0) o3->6aef9ffe-3b7b-498c-9a5a-a012c6970297@192.168.202.10@tcp:593/0 lens 488/4536 e 0 to 0 dl 1787115038 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787115027.780733:0:6583:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af07b6a7800 with x1873925602642688 ext(0->4095) 00002000:00010000:3.0:1787115027.780737:0:6583:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af07b6a7800 00010000:00010000:3.0:1787115027.784915:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115028.809513:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787115029.498771:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000020:00080000:2.0:1787115029.498795:0:5807:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8af073aebd80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1787115029.498801:0:5807:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af06f3dd100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8af073aebb40 00000020:00080000:2.0:1787115029.498804:0:5807:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af06f3dd400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af061cfe000 00000001:00080000:2.0:1787115029.498818:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1787115029.498840:0:5807:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1787115029.498864:0:5818:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787115029.499064:0:5818:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1787115029.600045:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1787115029.600081:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:2.0:1787115029.830303:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787115029.891877:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115029.891921:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115029.892003:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115029.892032:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115029.892056:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115029.892097:0:11900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602643072 00000100:00100000:0.0:1787115029.892122:0:11900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602643072 00000100:00100000:0.0:1787115029.892178:0:11900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602643200 00000100:00100000:0.0:1787115029.892181:0:11900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602643200 00000100:00100000:0.0:1787115029.892209:0:11900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 81 00000100:00100000:0.0:1787115029.892219:0:11900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2361:x1873925602643072:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787115029.892288:0:11900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2361:x1873925602643072:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 71us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115029.892296:0:11900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 81 00000100:00100000:0.0:1787115029.892313:0:11900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 82 00000100:00100000:0.0:1787115029.892319:0:11900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2361:x1873925602643200:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787115029.892353:0:11900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2361:x1873925602643200:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 34us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115029.892359:0:11900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 82 00000100:00080000:0.0:1787115029.892377:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787115029.892381:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787115029.892472:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602643328 00000100:00100000:2.0:1787115029.892477:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602643328 00000100:00100000:2.0:1787115029.892520:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 175 00000100:00100000:2.0:1787115029.892529:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067b55fc-03d7-46d6-801a-48936d919d16+5:2361:x1873925602643328:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787115029.892558:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067b55fc-03d7-46d6-801a-48936d919d16+5:2361:x1873925602643328:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 31us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115029.892564:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 175 00000100:00100000:2.0:1787115029.892575:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602642944 00000100:00100000:2.0:1787115029.892578:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602642944 00000100:00100000:2.0:1787115029.892600:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 176 00000100:00100000:2.0:1787115029.892605:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:2361:x1873925602642944:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787115029.892631:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:2361:x1873925602642944:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 26us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115029.892648:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 176 00000100:00080000:0.0:1787115029.892832:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787115029.893190:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602642816 00000100:00100000:0.0:1787115029.893195:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602642816 00000100:00100000:0.0:1787115029.893228:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 301 00000100:00100000:0.0:1787115029.893235:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2361:x1873925602642816:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787115029.893265:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2361:x1873925602642816:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 30us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115029.893271:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 301 00000100:00100000:2.0:1787115030.407731:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624643712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787115030.407830:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115030.407915:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624643712 00000100:00100000:2.0:1787115030.407924:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624643712 00000100:00100000:2.0:1787115030.407993:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787115030.408004:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624643712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787115030.408048:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787115030.408101:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624643712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115030.408132:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1787115030.408170:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787115030.408206:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787115030.408214:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8af07f7e5180, transno 4294967307 00000004:00080000:2.0:1787115030.408226:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1787115030.408248:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8af07f7e7b80, transno 4294967310 00000100:00100000:2.0:1787115030.408263:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624643712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787115030.408910:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624643968:0@lo:400:kworker.0 00000100:00100000:3.0:1787115030.408952:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115030.408988:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787115030.408995:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624643840:0@lo:400:kworker.0 00000100:00100000:3.0:1787115030.409021:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115030.409045:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624644352:0@lo:400:kworker.0 00000100:00100000:3.0:1787115030.409079:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115030.409140:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624643968 00000100:00100000:3.0:1787115030.409145:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624643968 00000100:00100000:3.0:1787115030.409183:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787115030.409191:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f19a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624643968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115030.409230:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f19a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624643968:12345-0@lo:400:kworker.0 Request processed in 40us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115030.409237:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787115030.409255:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624643840 00000100:00100000:3.0:1787115030.409258:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624643840 00000100:00100000:3.0:1787115030.409281:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787115030.409287:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3307:x1873925624643840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115030.409315:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3307:x1873925624643840:12345-0@lo:400:kworker.0 Request processed in 28us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115030.409321:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787115030.409345:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624644352 00000100:00100000:3.0:1787115030.409349:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624644352 00000100:00100000:3.0:1787115030.409380:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787115030.409387:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f19b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624644352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115030.409412:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f19b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624644352:12345-0@lo:400:kworker.0 Request processed in 27us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115030.409418:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787115030.409453:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624643840:0@lo:400:kworker.0 00000100:00100000:3.0:1787115030.409462:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1787115030.409466:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8af06ee8f100, transno 4294967322 00000004:00080000:3.0:1787115030.409474:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1787115030.409496:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624644352:0@lo:400:kworker.0 00000100:00100000:3.0:1787115030.409507:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624643968:0@lo:400:kworker.0 00000100:00100000:3.0:1787115030.409525:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f8cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624644224:0@lo:400:kworker.0 00000100:00100000:3.0:1787115030.409549:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115030.409567:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787115030.409573:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f8cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624644096:0@lo:400:kworker.0 00000100:00100000:3.0:1787115030.409594:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115030.409616:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624644224 00000100:00100000:3.0:1787115030.409620:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624644224 00000100:00100000:3.0:1787115030.409641:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624644096 00000100:00100000:3.0:1787115030.409644:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624644096 00000100:00100000:3.0:1787115030.409662:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787115030.409668:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624644224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115030.409701:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624644224:12345-0@lo:400:kworker.0 Request processed in 33us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115030.409707:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787115030.409719:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787115030.409725:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f19aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624644096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115030.409759:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f19aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624644096:12345-0@lo:400:kworker.0 Request processed in 25us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115030.409765:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787115030.409843:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f8cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624644096:0@lo:400:kworker.0 00000100:00100000:3.0:1787115030.409853:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f8cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624644224:0@lo:400:kworker.0 00000100:00080000:2.0:1787115030.410644:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787115030.410650:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787115030.854163:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787115030.917834:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624644480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787115030.917923:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115030.919730:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624644480 00000100:00100000:2.0:1787115030.919756:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624644480 00000100:00100000:2.0:1787115030.919802:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787115030.919812:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624644480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787115030.919845:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787115030.919907:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624644480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (1983us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115030.919927:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787115030.920046:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624644480:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787115031.896225:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115032.902029:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115033.925362:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787115034.074294:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115034.075068:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602643456 00000100:00100000:0.0:1787115034.075080:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602643456 00000100:00100000:0.0:1787115034.075329:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 238 00000100:00100000:0.0:1787115034.075340:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:11278:x1873925602643456:12345-192.168.202.10@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787115034.075436:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:11278:x1873925602643456:12345-192.168.202.10@tcp:60:lhsmtool_posix.0 Request processed in 99us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115034.075443:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 238 00000100:00080000:2.0:1787115034.075645:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787115034.081613:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115034.082004:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602643712 00000100:00100000:2.0:1787115034.082014:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602643712 00000100:00100000:2.0:1787115034.082136:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 65 00000100:00100000:2.0:1787115034.082147:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:11278:x1873925602643712:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787115034.082656:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+19:11278:x1873925602643712:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 Request processed in 509us (1050us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1787115034.082664:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 65 00000100:00100000:3.0:1787115034.388531:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115034.391800:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602643840 00000100:00100000:0.0:1787115034.391817:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602643840 00000100:00100000:0.0:1787115034.391905:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 239 00000100:00100000:0.0:1787115034.391915:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067b55fc-03d7-46d6-801a-48936d919d16+5:12077:x1873925602643840:12345-192.168.202.10@tcp:101:lsof.0 00010000:00010000:0.0:1787115034.391935:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115034.392014:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c92f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d17f1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115034.392102:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c92fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115034.392135:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c92fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115034.392148:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c92fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115034.392479:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787115034.392483:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787115034.392558:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c92fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115034.392584:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c92f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17f1 expref: 7 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115034.392599:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c92fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17f1 expref: 6 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115034.392608:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af044d99800) 00010000:00010000:0.0:1787115034.392611:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787115034.392614:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040031600, rc 0) 00000100:00100000:0.0:1787115034.392677:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067b55fc-03d7-46d6-801a-48936d919d16+6:12077:x1873925602643840:12345-192.168.202.10@tcp:101:lsof.0 Request processed in 764us (4157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115034.392684:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 239 00000100:00080000:2.0:1787115034.394100:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1787115034.574305:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1787115034.574323:0:5807:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1787115034.574344:0:5818:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787115034.574354:0:5818:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1787115034.949569:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787115035.004574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115035.004612:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115035.004638:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115035.004662:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115035.004692:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115035.004803:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602644480 00000100:00100000:3.0:1787115035.004814:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602644480 00000100:00100000:3.0:1787115035.004877:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602644096 00000100:00100000:3.0:1787115035.004880:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602644096 00000100:00100000:3.0:1787115035.004901:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 180 00000100:00100000:3.0:1787115035.004910:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067b55fc-03d7-46d6-801a-48936d919d16+6:2363:x1873925602644480:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787115035.004987:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067b55fc-03d7-46d6-801a-48936d919d16+6:2363:x1873925602644480:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 78us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115035.004994:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 180 00000100:00100000:3.0:1787115035.005009:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 181 00000100:00100000:3.0:1787115035.005014:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:2363:x1873925602644096:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787115035.005039:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:2363:x1873925602644096:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 25us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115035.005045:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 181 00000100:00100000:2.0:1787115035.007845:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602643968 00000100:00100000:2.0:1787115035.007863:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602643968 00000100:00100000:2.0:1787115035.008026:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 303 00000100:00100000:2.0:1787115035.008038:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2363:x1873925602643968:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787115035.008171:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2363:x1873925602643968:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 135us (3605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115035.008179:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 303 00000100:00100000:0.0:1787115035.008261:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602644224 00000100:00100000:0.0:1787115035.008275:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602644224 00000100:00100000:0.0:1787115035.008319:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602644352 00000100:00100000:0.0:1787115035.008323:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602644352 00000100:00100000:0.0:1787115035.008346:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 84 00000100:00100000:0.0:1787115035.008353:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f107800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2363:x1873925602644224:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787115035.008382:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f107800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2363:x1873925602644224:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 30us (3769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115035.008388:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 84 00000100:00100000:0.0:1787115035.008402:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 85 00000100:00100000:0.0:1787115035.008408:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f107100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2363:x1873925602644352:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787115035.008433:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f107100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2363:x1873925602644352:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 26us (3741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115035.008439:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 85 00000100:00080000:0.0:1787115035.008460:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787115035.008464:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787115035.525426:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f67c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624644992:0@lo:400:kworker.0 00000100:00100000:3.0:1787115035.525506:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115035.525566:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787115035.525573:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f67c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624644864:0@lo:400:kworker.0 00000100:00100000:3.0:1787115035.525599:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115035.525630:0:11900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624644992 00000100:00100000:3.0:1787115035.525651:0:11900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624644992 00000100:00100000:3.0:1787115035.525715:0:11900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787115035.525723:0:11900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b68ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624644992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115035.525786:0:11900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b68ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624644992:12345-0@lo:400:kworker.0 Request processed in 63us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115035.525793:0:11900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787115035.525828:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624644864 00000100:00100000:3.0:1787115035.525832:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624644864 00000100:00100000:3.0:1787115035.525859:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787115035.525878:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06c15b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624644864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115035.525907:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06c15b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624644864:12345-0@lo:400:kworker.0 Request processed in 42us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115035.525914:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787115035.525961:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f67c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624644864:0@lo:400:kworker.0 00000100:00100000:3.0:1787115035.525973:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f67c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624644992:0@lo:400:kworker.0 00000100:00100000:1.0:1787115035.526165:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f67f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624644736:0@lo:400:kworker.0 00000100:00100000:1.0:1787115035.526195:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115035.526225:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07b6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624645248:0@lo:400:kworker.0 00000100:00100000:1.0:1787115035.526247:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115035.526264:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787115035.526270:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f67f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624644608:0@lo:400:kworker.0 00000100:00100000:1.0:1787115035.526297:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115035.526317:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624645120:0@lo:400:kworker.0 00000100:00100000:1.0:1787115035.526339:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115035.526769:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624644608 00000100:00100000:3.0:1787115035.526775:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624644608 00000100:00100000:3.0:1787115035.526820:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787115035.526828:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624644608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115035.526878:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3309:x1873925624644608:12345-0@lo:400:kworker.0 Request processed in 51us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115035.526885:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787115035.526909:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624644736 00000100:00100000:3.0:1787115035.526912:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624644736 00000100:00100000:2.0:1787115035.526919:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624645376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787115035.526942:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624645120 00000100:00100000:3.0:1787115035.526945:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624645120 00000100:00100000:2.0:1787115035.526948:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115035.526962:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787115035.526974:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624644736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115035.526975:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624645376 00000100:00100000:2.0:1787115035.526977:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624645376 00000100:00100000:3.0:1787115035.527002:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624644736:12345-0@lo:400:kworker.0 Request processed in 28us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115035.527007:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787115035.527009:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787115035.527014:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624645376:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787115035.527017:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787115035.527021:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624645120:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1787115035.527042:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787115035.527077:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624645376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115035.527083:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787115035.527135:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624645376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787115035.527175:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f67f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6bfcc0b7-8035-40e1-91c8-e687d170788c:3309:1873925624644608:0@lo:400:kworker.0 00000100:00100000:2.0:1787115035.527186:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f67f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624644736:0@lo:400:kworker.0 00000100:00100000:3.0:1787115035.527205:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624645120:12345-0@lo:400:kworker.0 Request processed in 183us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115035.527207:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624645120:0@lo:400:kworker.0 00000100:00100000:3.0:1787115035.527211:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787115035.527881:0:11535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624645248 00000100:00100000:0.0:1787115035.527888:0:11535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624645248 00000100:00100000:0.0:1787115035.527930:0:11535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787115035.527937:0:11535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f104700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624645248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787115035.528000:0:11535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f104700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624645248:12345-0@lo:400:kworker.0 Request processed in 64us (1752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115035.528007:0:11535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1787115035.528008:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787115035.528012:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787115035.528014:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787115035.528126:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07b6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624645248:0@lo:400:kworker.0 00010000:00010000:3.0:1787115035.973546:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787115036.037390:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624645504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787115036.037468:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115036.037590:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624645504 00000100:00100000:2.0:1787115036.037600:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624645504 00000100:00100000:2.0:1787115036.037663:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787115036.037673:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624645504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787115036.037718:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787115036.037774:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624645504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115036.037782:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787115036.038072:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624645504:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787115036.485642:0:11519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787115036.485653:0:11519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787115036.486837:0:11519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1787115036.486847:0:11519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787115036.997656:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115038.022367:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787115038.277179:0:12604:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 00:50:37 (1787115037) 00010000:00010000:0.0:1787115039.045396:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115040.069246:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787115040.121489:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115040.121534:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115040.121566:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115040.121590:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115040.121613:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115040.121638:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602644992 00000100:00100000:1.0:1787115040.121646:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602644992 00000100:00100000:1.0:1787115040.121703:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602644864 00000100:00100000:1.0:1787115040.121705:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602644864 00000100:00100000:1.0:1787115040.121727:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 88 00000100:00100000:1.0:1787115040.121736:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f104a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2363:x1873925602644992:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787115040.121803:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f104a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2363:x1873925602644992:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 69us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115040.121811:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 88 00000100:00100000:1.0:1787115040.121838:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 89 00000100:00100000:1.0:1787115040.121844:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07b6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2363:x1873925602644864:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787115040.121865:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07b6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2363:x1873925602644864:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 22us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115040.121872:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 89 00000100:00100000:3.0:1787115040.122023:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602644736 00000100:00100000:3.0:1787115040.122027:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602644736 00000100:00100000:3.0:1787115040.122061:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602645120 00000100:00100000:3.0:1787115040.122064:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602645120 00000100:00100000:3.0:1787115040.122084:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 185 00000100:00100000:3.0:1787115040.122091:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:2363:x1873925602644736:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787115040.122144:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:2363:x1873925602644736:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 53us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115040.122150:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 185 00000100:00100000:3.0:1787115040.122174:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 186 00000100:00100000:3.0:1787115040.122180:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af05125f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067b55fc-03d7-46d6-801a-48936d919d16+6:2363:x1873925602645120:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787115040.122201:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af05125f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067b55fc-03d7-46d6-801a-48936d919d16+6:2363:x1873925602645120:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 22us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115040.122207:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 186 00000100:00080000:3.0:1787115040.122226:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787115040.122230:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787115040.122232:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787115040.123258:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602644608 00000100:00100000:3.0:1787115040.123267:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602644608 00000100:00100000:3.0:1787115040.123303:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 305 00000100:00100000:3.0:1787115040.123309:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2363:x1873925602644608:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:3.0:1787115040.123348:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2363:x1873925602644608:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 39us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115040.123353:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 305 00000100:00100000:0.0:1787115040.645729:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624645888:0@lo:400:kworker.0 00000100:00100000:0.0:1787115040.645830:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115040.645890:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787115040.645896:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624646016:0@lo:400:kworker.0 00000100:00100000:0.0:1787115040.645923:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115040.646049:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624645632:0@lo:400:kworker.0 00000100:00100000:3.0:1787115040.646084:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115040.646129:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624646144:0@lo:400:kworker.0 00000100:00100000:3.0:1787115040.646151:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115040.646187:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787115040.646193:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624645760:0@lo:400:kworker.0 00000100:00100000:3.0:1787115040.646213:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115040.646229:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624646272:0@lo:400:kworker.0 00000100:00100000:3.0:1787115040.646250:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115040.646279:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624645888 00000100:00100000:3.0:1787115040.646293:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624645888 00000100:00100000:3.0:1787115040.646346:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624646144 00000100:00100000:3.0:1787115040.646349:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624646144 00000100:00100000:3.0:1787115040.646362:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624645760 00000100:00100000:3.0:1787115040.646364:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624645760 00000100:00100000:3.0:1787115040.646378:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787115040.646385:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624645888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115040.646438:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624645888:12345-0@lo:400:kworker.0 Request processed in 52us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115040.646446:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787115040.646465:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787115040.646471:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624646144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115040.646514:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624646144:12345-0@lo:400:kworker.0 Request processed in 42us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115040.646520:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787115040.646531:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787115040.646537:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624645760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115040.646560:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624645760:12345-0@lo:400:kworker.0 Request processed in 24us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115040.646566:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787115040.646584:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624646016 00000100:00100000:3.0:1787115040.646587:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624646016 00000100:00100000:3.0:1787115040.646611:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624646272 00000100:00100000:3.0:1787115040.646613:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624646272 00000100:00100000:3.0:1787115040.646630:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787115040.646637:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624646016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115040.646680:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624646016:12345-0@lo:400:kworker.0 Request processed in 44us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115040.646695:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787115040.646709:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787115040.646714:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f67c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624646272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115040.646740:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f67c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624646272:12345-0@lo:400:kworker.0 Request processed in 27us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115040.646745:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1787115040.646767:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787115040.646770:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787115040.646773:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787115040.646808:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624645760:0@lo:400:kworker.0 00000100:00100000:3.0:1787115040.647941:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624646272:0@lo:400:kworker.0 00000100:00100000:3.0:1787115040.647964:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624646144:0@lo:400:kworker.0 00000100:00100000:3.0:1787115040.648005:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624646400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787115040.648058:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115040.648096:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624646016:0@lo:400:kworker.0 00000100:00100000:3.0:1787115040.648125:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624645888:0@lo:400:kworker.0 00000100:00100000:3.0:1787115040.648157:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624646400 00000100:00100000:3.0:1787115040.650800:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624646400 00000100:00100000:3.0:1787115040.651052:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787115040.651062:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624646400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787115040.651103:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787115040.651207:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624646400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (3161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115040.651230:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787115040.653970:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624645632 00000100:00100000:0.0:1787115040.653983:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624645632 00000100:00100000:0.0:1787115040.654366:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1787115040.654379:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624645632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787115040.654675:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624645632:12345-0@lo:400:kworker.0 Request processed in 298us (8590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115040.654747:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624645632:0@lo:400:kworker.0 00000100:00100000:0.0:1787115040.655325:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787115040.658062:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624646400:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787115041.093291:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787115041.158464:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624646528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787115041.158540:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115041.158632:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624646528 00000100:00100000:3.0:1787115041.158641:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624646528 00000100:00100000:3.0:1787115041.158705:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787115041.158714:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624646528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787115041.158747:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787115041.165702:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624646528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6978us (7151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115041.165717:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787115041.170610:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624646528:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787115042.117907:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787115042.815558:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115042.815678:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602645376 00000100:00100000:2.0:1787115042.815689:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602645376 00000100:00100000:2.0:1787115042.815753:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 66 00000100:00100000:2.0:1787115042.815763:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+18:12298:x1873925602645376:12345-192.168.202.10@tcp:35:umount.0 00000100:00100000:2.0:1787115042.816327:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+19:12298:x1873925602645376:12345-192.168.202.10@tcp:35:umount.0 Request processed in 563us (776us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787115042.816341:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 66 00000100:00080000:3.0:1787115042.816554:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787115042.819571:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115042.819887:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602645632 00000100:00100000:2.0:1787115042.819897:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602645632 00000100:00100000:2.0:1787115042.819956:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 67 00000100:00100000:2.0:1787115042.819966:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+19:12298:x1873925602645632:12345-192.168.202.10@tcp:35:umount.0 00000100:00100000:2.0:1787115042.820349:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+20:12298:x1873925602645632:12345-192.168.202.10@tcp:35:umount.0 Request processed in 383us (785us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787115042.820356:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 67 00000100:00100000:0.0:1787115042.823151:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115042.823293:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602645888 00000100:00100000:2.0:1787115042.823302:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602645888 00000100:00100000:2.0:1787115042.823393:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 68 00000100:00100000:2.0:1787115042.823403:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06634b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+20:12298:x1873925602645888:12345-192.168.202.10@tcp:35:umount.0 00000100:00100000:2.0:1787115042.823837:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06634b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+21:12298:x1873925602645888:12345-192.168.202.10@tcp:35:umount.0 Request processed in 434us (693us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787115042.823845:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 68 00000100:00100000:0.0:1787115042.829508:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115042.829831:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602646144 00000100:00100000:2.0:1787115042.829844:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602646144 00000100:00100000:2.0:1787115042.829896:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 69 00000100:00100000:2.0:1787115042.829909:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+21:12298:x1873925602646144:12345-192.168.202.10@tcp:35:umount.0 00000100:00100000:2.0:1787115042.830410:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+22:12298:x1873925602646144:12345-192.168.202.10@tcp:35:umount.0 Request processed in 503us (913us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787115042.830419:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 69 00000100:00100000:3.0:1787115042.838743:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115042.838782:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115042.838816:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115042.838984:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602646272 00000100:00100000:2.0:1787115042.838995:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602646272 00000100:00100000:2.0:1787115042.839071:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602646528 00000100:00100000:2.0:1787115042.839081:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602646528 00000100:00100000:2.0:1787115042.839094:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602646400 00000100:00100000:2.0:1787115042.839096:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602646400 00000100:00100000:2.0:1787115042.839130:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 18 00000100:00100000:2.0:1787115042.839139:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+15:2363:x1873925602646272:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115042.839155:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115042.839181:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af041683e00/0x194cd781e88c8374 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d137c expref: 15 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115042.839196:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115042.839239:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+14:2363:x1873925602646272:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 101us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115042.839246:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 18 00000100:00100000:2.0:1787115042.839261:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00100000:2.0:1787115042.839266:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046f81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+13:2363:x1873925602646528:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115042.839273:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115042.839281:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af0429ca200/0x194cd781e88c855e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1447 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115042.839290:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115042.839303:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046f81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:2363:x1873925602646528:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 38us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115042.839309:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00100000:2.0:1787115042.839349:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 20 00000100:00100000:2.0:1787115042.839355:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+11:2363:x1873925602646400:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115042.839361:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115042.839373:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af042cb3400/0x194cd781e88c82da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1344 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115042.839382:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115042.839396:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2363:x1873925602646400:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 42us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115042.839402:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 20 00000100:00100000:0.0:1787115042.842501:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115042.842615:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602646912 00000100:00100000:3.0:1787115042.842624:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602646912 00000100:00100000:3.0:1787115042.842706:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 72 00000100:00100000:3.0:1787115042.842715:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+7:2360:x1873925602646912:12345-192.168.202.10@tcp:9:umount.0 00000020:00000080:3.0:1787115042.842741:0:6577:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c88b4 00000020:00010000:3.0:1787115042.842748:0:6577:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8af046f21000: total 0 00000100:00080000:3.0:1787115042.842752:0:6577:0:(import.c:65:import_set_state_nolock()) ffff8af046f20800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787115042.842793:0:6577:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787115042.843063:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2360:x1873925602646912:12345-192.168.202.10@tcp:9:umount.0 Request processed in 349us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115042.843071:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 72 00000020:00010000:2.0:1787115042.843366:0:5773:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8af046f21000: total 0 00010000:00010000:2.0:1787115042.843397:0:5773:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8af046f21000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787115042.843453:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052fff536/0x194cd781e88c8c50 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d161c expref: 4 pid: 11900 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115042.843485:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c92ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17ea expref: 3 pid: 6578 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115042.843500:0:5773:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8af046f21000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787115042.843510:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115042.843513:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115042.843514:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787115042.843673:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787115042.850458:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115042.850534:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602647040 00000100:00100000:3.0:1787115042.850556:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602647040 00000100:00100000:3.0:1787115042.850621:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 73 00000100:00100000:3.0:1787115042.850631:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+5:2360:x1873925602647040:12345-192.168.202.10@tcp:9:umount.0 00000020:00000080:3.0:1787115042.850698:0:6576:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c864c 00000100:00080000:3.0:1787115042.850707:0:6576:0:(import.c:65:import_set_state_nolock()) ffff8af043120000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787115042.850747:0:6576:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787115042.851022:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+2:2360:x1873925602647040:12345-192.168.202.10@tcp:9:umount.0 Request processed in 392us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115042.851031:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 73 00000100:00080000:0.0:1787115042.851418:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787115042.853484:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787115042.862260:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115042.862446:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602648064 00000100:00100000:0.0:1787115042.862456:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602648064 00000100:00100000:0.0:1787115042.862510:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 240 00000100:00100000:0.0:1787115042.862519:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+22:2360:x1873925602648064:12345-192.168.202.10@tcp:39:umount.0 00000020:00000080:0.0:1787115042.862556:0:5785:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c82e8 00000020:00010000:0.0:1787115042.862584:0:5785:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8af045135000: total 0 00000100:00080000:0.0:1787115042.862588:0:5785:0:(import.c:65:import_set_state_nolock()) ffff8af045137000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787115042.862616:0:5785:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1787115042.862974:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6aef9ffe-3b7b-498c-9a5a-a012c6970297+21:2360:x1873925602648064:12345-192.168.202.10@tcp:39:umount.0 Request processed in 455us (724us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1787115042.862983:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 240 00000020:00010000:1.0:1787115042.863318:0:8291:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8af045135000: total 0 00010000:00010000:1.0:1787115042.863365:0:8291:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8af045135000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787115042.863394:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:1.0:1787115042.863397:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787115042.863415:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0000/0x194cd781e88c8b31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d15cf expref: 20 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115042.863432:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:1.0:1787115042.863435:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787115042.863439:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c8622 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1471 expref: 19 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115042.863485:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:1.0:1787115042.863487:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787115042.863492:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c91cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d179d expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115042.863505:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af044d99800) 00010000:00010000:1.0:1787115042.863508:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787115042.863511:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af0429ca000/0x194cd781e88c8cb2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1638 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115042.863524:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8af0510d6d00) 00010000:00010000:1.0:1787115042.863526:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787115042.863529:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1600/0x194cd781e88c85ce lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d145c expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115042.863560:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:1.0:1787115042.863562:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787115042.863566:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c92af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17d5 expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115042.863578:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8af044d99700) 00010000:00010000:1.0:1787115042.863580:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787115042.863583:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2400/0x194cd781e88c92d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17e3 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115042.863597:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:1.0:1787115042.863600:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787115042.863603:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1e00/0x194cd781e88c8c11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1607 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115042.863614:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8af051ecb300) 00010000:00010000:1.0:1787115042.863615:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787115042.863619:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c8c3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1615 expref: 12 pid: 7216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115042.863643:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:1.0:1787115042.863646:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787115042.863650:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216f800/0x194cd781e88c8fad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1711 expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115042.863664:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8af0510d6400) 00010000:00010000:1.0:1787115042.863666:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787115042.863674:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c890f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1543 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115042.863689:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8af0514c6700) 00010000:00010000:1.0:1787115042.863691:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787115042.863695:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c85b2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1455 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115042.863709:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8af0514c6f00) 00010000:00010000:1.0:1787115042.863710:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787115042.863713:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216fa00/0x194cd781e88c8cce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d163f expref: 8 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115042.863726:0:8291:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8af045135000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1787115042.863739:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115042.863742:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115042.863743:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115043.141782:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787115043.777383:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115043.777430:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115043.777467:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115043.777497:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602648192 00000100:00100000:0.0:1787115043.777506:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602648192 00000100:00100000:0.0:1787115043.777557:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602648448 00000100:00100000:0.0:1787115043.777560:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602648448 00000100:00100000:0.0:1787115043.777570:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602648320 00000100:00100000:0.0:1787115043.777572:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602648320 00000100:00100000:0.0:1787115043.777586:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 21 00000100:00100000:0.0:1787115043.777593:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+12:2364:x1873925602648192:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787115043.777610:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787115043.777639:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af041682a00/0x194cd781e88c83ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1391 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115043.777662:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787115043.777705:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+11:2364:x1873925602648192:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 113us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115043.777713:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 21 00000100:00100000:0.0:1787115043.777734:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 22 00000100:00100000:0.0:1787115043.777740:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+10:2364:x1873925602648448:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787115043.777763:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787115043.777771:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af0429cb200/0x194cd781e88c8557 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1440 expref: 10 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115043.777781:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787115043.777807:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+9:2364:x1873925602648448:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 67us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115043.777813:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 22 00000100:00100000:0.0:1787115043.777825:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 23 00000100:00100000:0.0:1787115043.777831:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eecd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+8:2364:x1873925602648320:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787115043.777838:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787115043.777846:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af041682600/0x194cd781e88c83c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d13bb expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115043.777854:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787115043.777867:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eecd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+7:2364:x1873925602648320:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 37us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115043.777873:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 23 00000100:00100000:2.0:1787115043.791747:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115043.791941:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602648704 00000100:00100000:3.0:1787115043.791951:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602648704 00000100:00100000:3.0:1787115043.792017:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 241 00000100:00100000:3.0:1787115043.792026:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067b55fc-03d7-46d6-801a-48936d919d16+6:2360:x1873925602648704:12345-192.168.202.10@tcp:39:umount.0 00000020:00000080:3.0:1787115043.792073:0:5786:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c83cf 00000020:00010000:3.0:1787115043.792081:0:5786:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8af045131000: total 0 00000100:00080000:3.0:1787115043.792085:0:5786:0:(import.c:65:import_set_state_nolock()) ffff8af045130000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787115043.792140:0:5786:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1787115043.792344:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067b55fc-03d7-46d6-801a-48936d919d16+5:2360:x1873925602648704:12345-192.168.202.10@tcp:39:umount.0 Request processed in 319us (605us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1787115043.792352:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 241 00000020:00010000:2.0:1787115043.792566:0:5773:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8af045131000: total 0 00010000:00010000:2.0:1787115043.792606:0:5773:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8af045131000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787115043.792647:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af044d99800) 00010000:00010000:2.0:1787115043.792651:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787115043.792659:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c92fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d17f1 expref: 4 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115043.792682:0:5773:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8af045131000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787115043.792704:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115043.792706:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115043.792708:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787115043.793959:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787115043.813891:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115043.814025:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602648960 00000100:00100000:1.0:1787115043.814039:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602648960 00000100:00100000:1.0:1787115043.814094:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 307 00000100:00100000:1.0:1787115043.814167:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+7:2360:x1873925602648960:12345-192.168.202.10@tcp:251:umount.0 00000020:00000080:1.0:1787115043.814207:0:5780:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c82c5 00000020:00010000:1.0:1787115043.814214:0:5780:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8af06f4b8800: total 0 00000100:00080000:1.0:1787115043.814218:0:5780:0:(import.c:65:import_set_state_nolock()) ffff8af06f4bd800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787115043.814299:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e19d3d13-0e41-457d-ab9f-79e10e5fe0d9+3:2360:x1873925602648960:12345-192.168.202.10@tcp:251:umount.0 Request processed in 196us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115043.814306:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 307 00000020:00010000:2.0:1787115043.814515:0:8290:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8af06f4b8800: total 0 00010000:00010000:2.0:1787115043.814519:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115043.814560:0:8290:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8af06f4b8800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787115043.814590:0:8290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af041683800/0x194cd781e88c837b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1383 expref: 2 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115043.814606:0:8290:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8af06f4b8800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787115043.814614:0:8290:0:(genops.c:906:class_export_put()) final put ffff8af06f4b8800/e19d3d13-0e41-457d-ab9f-79e10e5fe0d9 00010000:00010000:2.0:1787115043.814640:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115043.814642:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115043.814644:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787115043.816216:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8af06f4b8800/e19d3d13-0e41-457d-ab9f-79e10e5fe0d9 for MGS 00000020:00000080:1.0:1787115043.816258:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af06f4bd800 for MGS 00010000:00010000:3.0:1787115044.168118:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787115044.847638:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6aef9ffe-3b7b-498c-9a5a-a012c6970297 00000020:00000080:0.0:1787115044.847651:0:7483:0:(genops.c:906:class_export_put()) final put ffff8af046f21000/6aef9ffe-3b7b-498c-9a5a-a012c6970297 00000020:00000080:0.0:1787115044.847689:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8af046f21000/6aef9ffe-3b7b-498c-9a5a-a012c6970297 for lustre-OST0001 00000020:00000080:0.0:1787115044.847745:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af046f20800 for lustre-OST0001 00000001:00100000:0.0:1787115044.877084:0:5807:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6aef9ffe-3b7b-498c-9a5a-a012c6970297 00000001:00080000:0.0:1787115044.877103:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1787115044.877180:0:5807:0:(genops.c:906:class_export_put()) final put ffff8af045135000/6aef9ffe-3b7b-498c-9a5a-a012c6970297 00000001:00100000:0.0:1787115044.877205:0:5807:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 067b55fc-03d7-46d6-801a-48936d919d16 00000001:00080000:0.0:1787115044.877212:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1787115044.877214:0:5807:0:(genops.c:906:class_export_put()) final put ffff8af045131000/067b55fc-03d7-46d6-801a-48936d919d16 00000020:00000080:0.0:1787115044.877384:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8af045135000/6aef9ffe-3b7b-498c-9a5a-a012c6970297 for lustre-MDT0000 00000020:00000080:0.0:1787115044.877439:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8af045131000/067b55fc-03d7-46d6-801a-48936d919d16 for lustre-MDT0000 00000020:00000080:0.0:1787115044.877480:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af045137000 for lustre-MDT0000 00000020:00000080:0.0:1787115044.877485:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af045130000 for lustre-MDT0000 00010000:00010000:0.0:1787115045.190776:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787115045.772635:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624646656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787115045.772711:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115045.772722:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624647040:0@lo:400:kworker.0 00000100:00100000:2.0:1787115045.772772:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624647168:0@lo:400:kworker.0 00000100:00100000:0.0:1787115045.772773:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115045.772809:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115045.772810:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787115045.772827:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787115045.772830:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624646912:0@lo:400:kworker.0 00000100:00100000:2.0:1787115045.772833:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eeced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624646784:0@lo:400:kworker.0 00000100:00100000:2.0:1787115045.772868:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115045.772877:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115045.772889:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624647296:0@lo:400:kworker.0 00000100:00100000:0.0:1787115045.772907:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624647424:0@lo:400:kworker.0 00000100:00100000:2.0:1787115045.772914:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115045.772942:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115045.772961:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624646656 00000100:00100000:2.0:1787115045.772970:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624646656 00000100:00100000:0.0:1787115045.772980:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624647040 00000100:00100000:0.0:1787115045.772986:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624647040 00000100:00100000:0.0:1787115045.773038:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624646912 00000100:00100000:2.0:1787115045.773039:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787115045.773043:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624646912 00000100:00100000:2.0:1787115045.773052:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624646656:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787115045.773061:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624647296 00000100:00100000:0.0:1787115045.773065:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624647296 00000100:00100000:0.0:1787115045.773081:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787115045.773088:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624647040:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1787115045.773092:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787115045.773163:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873925624647040:12345-0@lo:400:kworker.0 Request processed in 74us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115045.773171:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787115045.773182:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624646656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115045.773190:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787115045.773192:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787115045.773200:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624646912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115045.773220:0:11900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624647168 00000100:00100000:2.0:1787115045.773225:0:11900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624647168 00000100:00100000:0.0:1787115045.773238:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624646912:12345-0@lo:400:kworker.0 Request processed in 40us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115045.773245:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787115045.773252:0:11900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624647424 00000100:00100000:2.0:1787115045.773256:0:11900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624647424 00000100:00100000:2.0:1787115045.773280:0:11900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787115045.773286:0:11900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624647168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787115045.773463:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787115045.773470:0:11900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624647168:12345-0@lo:400:kworker.0 Request processed in 184us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115045.773477:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624647296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115045.773478:0:11900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787115045.773490:0:11900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787115045.773496:0:11900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624647424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787115045.773524:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624647296:12345-0@lo:400:kworker.0 Request processed in 51us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115045.773533:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787115045.773534:0:11900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624647424:12345-0@lo:400:kworker.0 Request processed in 37us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115045.773538:0:11900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787115045.773550:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624646784 00000100:00100000:2.0:1787115045.773554:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624646784 00000100:00100000:2.0:1787115045.773574:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1787115045.773579:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af04561b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624646784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115045.773600:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af04561b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624646784:12345-0@lo:400:kworker.0 Request processed in 23us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115045.773605:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624646912:0@lo:400:kworker.0 00000100:00100000:2.0:1787115045.773616:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00080000:2.0:1787115045.773689:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787115045.773692:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787115045.773694:0:5781:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787115045.773706:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eeced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624646784:0@lo:400:kworker.0 00000100:00100000:2.0:1787115045.773720:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624647296:0@lo:400:kworker.0 00000100:00100000:2.0:1787115045.773726:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624647168:0@lo:400:kworker.0 00000100:00100000:2.0:1787115045.773739:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624646656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787115045.773886:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624647424:0@lo:400:kworker.0 00000100:00100000:0.0:1787115045.773901:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873925624647040:0@lo:400:kworker.0 00000020:01000004:3.0:1787115045.836779:0:12804:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787115045.856338:0:12804:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787115045.856386:0:12804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c834a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8351 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115045.856413:0:12804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c834a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8351 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115045.856421:0:12804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c834a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c8351 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115045.856428:0:12804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c834a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c8351 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115045.856448:0:12804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787115045.856454:0:12804:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787115045.856475:0:12804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787115045.856479:0:12804:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787115045.856485:0:12804:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787115045.856506:0:12804:0:(import.c:65:import_set_state_nolock()) ffff8af06e906800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787115045.856698:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787115045.856705:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c834a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c8351 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115045.856713:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364000 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1787115045.856717:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c834a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c8351 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115045.856726:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c834a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x194cd781e88c8351 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787115045.856734:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c834a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x194cd781e88c8351 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787115045.856739:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787115045.856742:0:5773:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787115045.856744:0:5773:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787115045.856780:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c834a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x194cd781e88c8351 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115045.856786:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787115045.856809:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c834a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x194cd781e88c8351 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115045.856817:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af052364000/0x194cd781e88c834a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x194cd781e88c8351 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115045.856834:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115045.856836:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115045.856838:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787115045.856964:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624647680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787115045.857023:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115045.857222:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624647680 00000100:00100000:1.0:1787115045.857236:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624647680 00000100:00100000:1.0:1787115045.857301:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787115045.857310:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3307:x1873925624647680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787115045.857326:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787115045.857340:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af042cb2600/0x194cd781e88c8351 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x194cd781e88c834a expref: 19 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115045.857352:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115045.858748:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873925624647552:0@lo:39:umount.0 00000100:00100000:1.0:1787115045.858957:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:3307:x1873925624647680:12345-0@lo:103:ldlm_bl.0 Request processed in 1646us (1931us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115045.858966:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787115045.859278:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624647680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787115045.859632:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115045.866010:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624647552 00000100:00100000:0.0:1787115045.866023:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624647552 00000100:00100000:3.0:1787115045.866315:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787115045.866325:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873925624647552:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787115045.866358:0:5785:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c80d4 00000100:00080000:3.0:1787115045.866366:0:5785:0:(import.c:65:import_set_state_nolock()) ffff8af04565d000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787115045.866469:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3305:x1873925624647552:12345-0@lo:39:umount.0 Request processed in 145us (6837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115045.866477:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1787115045.866500:0:5785:0:(genops.c:906:class_export_put()) final put ffff8af04565e000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1787115045.866728:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787115045.866762:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af06e906800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787115045.866784:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873925624647552:0@lo:39:umount.0 00000100:00080000:3.0:1787115045.873533:0:12804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787115045.873542:0:12804:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787115045.873549:0:12804:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787115045.874818:0:12804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8358 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c835f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115045.875189:0:12804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8358 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c835f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115045.875196:0:12804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8358 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c835f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115045.875203:0:12804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c835f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115045.875222:0:12804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787115045.875229:0:12804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429cbc00/0x194cd781e88c827f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8286 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115045.875236:0:12804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429cbc00/0x194cd781e88c827f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8286 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115045.875242:0:12804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429cbc00/0x194cd781e88c827f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c8286 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115045.875248:0:12804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff8af0429cbc00/0x194cd781e88c827f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c8286 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115045.875260:0:12804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787115045.875364:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787115045.875372:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c835f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115045.875380:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052365200 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1787115045.875385:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c835f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115045.875394:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x194cd781e88c835f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787115045.875402:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x194cd781e88c835f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787115045.875407:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787115045.875410:0:5774:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1787115045.875448:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8358 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x194cd781e88c835f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115045.875474:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787115045.875499:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8358 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x194cd781e88c835f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115045.875507:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af052365200/0x194cd781e88c8358 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x194cd781e88c835f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115045.875521:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115045.875524:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af0429cbc00/0x194cd781e88c827f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c8286 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115045.875531:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cbc00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1787115045.875534:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af0429cbc00/0x194cd781e88c827f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c8286 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115045.875540:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af0429cbc00/0x194cd781e88c827f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x194cd781e88c8286 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787115045.875546:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af0429cbc00/0x194cd781e88c827f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x194cd781e88c8286 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787115045.875553:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787115045.875555:0:5774:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1787115045.875567:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af0429cbc00/0x194cd781e88c827f lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x194cd781e88c8286 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115045.875573:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787115045.875579:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af0429cbc00/0x194cd781e88c827f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x194cd781e88c8286 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115045.875597:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115045.875599:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115045.875602:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787115045.875633:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624647808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787115045.875702:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115045.875747:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787115045.875754:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624647936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787115045.875793:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115045.875904:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624647808 00000100:00100000:2.0:1787115045.875912:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624647808 00000100:00100000:2.0:1787115045.876024:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624647936 00000100:00100000:2.0:1787115045.876028:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624647936 00000100:00100000:2.0:1787115045.876140:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787115045.876151:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6bfcc0b7-8035-40e1-91c8-e687d170788c+19:3308:x1873925624647808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787115045.876164:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115045.876179:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af0429cb800/0x194cd781e88c835f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x194cd781e88c8358 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115045.876191:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115045.876225:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6bfcc0b7-8035-40e1-91c8-e687d170788c+18:3308:x1873925624647808:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115045.876232:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787115045.876248:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787115045.876253:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0431e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6bfcc0b7-8035-40e1-91c8-e687d170788c+17:3308:x1873925624647936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787115045.876260:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787115045.876363:0:12804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af0429cbc00/0x194cd781e88c827f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x194cd781e88c8286 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787115045.876377:0:12804:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787115045.876385:0:12804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8581 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8588 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115045.876393:0:12804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8581 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8588 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115045.876400:0:12804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8581 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c8588 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115045.876407:0:12804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8581 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c8588 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115045.876419:0:12804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787115045.876424:0:12804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365800/0x194cd781e88c8033 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c803a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115045.876431:0:12804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365800/0x194cd781e88c8033 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c803a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115045.876437:0:12804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365800/0x194cd781e88c8033 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c803a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115045.876444:0:12804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff8af052365800/0x194cd781e88c8033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c803a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115045.876455:0:12804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787115045.876458:0:12804:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1787115045.876466:0:12804:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1787115045.876492:0:12804:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787115045.876495:0:12804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787115045.876500:0:12804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787115045.876505:0:12804:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:3.0:1787115045.876510:0:12804:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8af077cc2000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787115045.876516:0:12804:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8af077f9a000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787115045.876521:0:12804:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff8af05916b380) has exports, disconnecting them 00000020:00080000:3.0:1787115045.876525:0:12804:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8af077cc2000), last request at 1787115045 00000020:00000080:3.0:1787115045.876531:0:12804:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c8247 00000100:00080000:3.0:1787115045.876549:0:12804:0:(import.c:65:import_set_state_nolock()) ffff8af077cc6000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787115045.876596:0:12804:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8af077cc2000): rc 0 00000020:00000080:3.0:1787115045.876599:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af077cc2000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:1.0:1787115045.876666:0:8291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787115045.876674:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8581 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c8588 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115045.876682:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052365400 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1787115045.876685:0:8291:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8581 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c8588 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115045.876693:0:8291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8581 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x194cd781e88c8588 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787115045.876699:0:8291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8581 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x194cd781e88c8588 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787115045.876705:0:8291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787115045.876708:0:8291:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787115045.876709:0:8291:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787115045.876731:0:8291:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8581 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x194cd781e88c8588 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115045.876748:0:8291:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787115045.876774:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8581 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x194cd781e88c8588 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115045.876781:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c8581 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x194cd781e88c8588 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115045.876791:0:8291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787115045.876794:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af052365800/0x194cd781e88c8033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c803a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115045.876800:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052365800 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1787115045.876803:0:8291:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af052365800/0x194cd781e88c8033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c803a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115045.876810:0:8291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af052365800/0x194cd781e88c8033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x194cd781e88c803a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787115045.876816:0:8291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af052365800/0x194cd781e88c8033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x194cd781e88c803a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115045.876900:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af042cb3600/0x194cd781e88c8286 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x194cd781e88c827f expref: 17 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115045.876917:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:1.0:1787115045.877006:0:8291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787115045.877009:0:8291:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787115045.877011:0:8291:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787115045.877025:0:8291:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af052365800/0x194cd781e88c8033 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x194cd781e88c803a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115045.877032:0:8291:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787115045.877038:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af052365800/0x194cd781e88c8033 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x194cd781e88c803a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115045.877146:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af052365800/0x194cd781e88c8033 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x194cd781e88c803a expref: -99 pid: 5766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115045.877159:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115045.877161:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115045.877163:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787115045.877178:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624648192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787115045.877214:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115045.877245:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787115045.877251:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624648064:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1787115045.877430:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8af04565e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787115045.877502:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af04565d000 for lustre-MDT0000 00000100:00100000:2.0:1787115045.877562:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0431e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:3308:x1873925624647936:12345-0@lo:103:ldlm_bl.0 Request processed in 1308us (1767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115045.877570:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787115045.877623:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624648192 00000100:00100000:2.0:1787115045.877628:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624648192 00000100:00100000:2.0:1787115045.877650:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787115045.877656:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6bfcc0b7-8035-40e1-91c8-e687d170788c+16:3307:x1873925624648192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787115045.877665:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115045.877674:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af08216e000/0x194cd781e88c803a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x194cd781e88c8033 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115045.877689:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115045.877709:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:3307:x1873925624648192:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115045.877715:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1787115045.877738:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787115045.877760:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624647936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787115045.877769:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624647808:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787115045.877788:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787115045.877957:0:12804:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8af077f9a000), last request at 1787115045 00000020:00000080:3.0:1787115045.877963:0:12804:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c817c 00000100:00080000:3.0:1787115045.877970:0:12804:0:(import.c:65:import_set_state_nolock()) ffff8af077f9b800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787115045.877991:0:12804:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8af077f9a000): rc 0 00000020:00000080:3.0:1787115045.877993:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af077f9a000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1787115045.878000:0:12804:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff96d240c87ae0 00000100:00080000:3.0:1787115045.878018:0:12804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787115045.878021:0:12804:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1787115045.878030:0:12804:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:2.0:1787115045.878182:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787115045.878260:0:12804:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787115045.878332:0:12804:0:(import.c:65:import_set_state_nolock()) ffff8af07b224000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787115045.878368:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624648320:0@lo:9:umount.0 00000100:00100000:2.0:1787115045.878401:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787115045.878438:0:12804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787115045.878440:0:12804:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1787115045.878448:0:12804:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787115045.878518:0:12804:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787115045.878527:0:12804:0:(import.c:65:import_set_state_nolock()) ffff8af045130800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:0.0:1787115045.878580:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8af077cc2000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787115045.878624:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8af077f9a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787115045.878657:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af077cc6000 for lustre-MDT0000 00000020:00000080:0.0:1787115045.878661:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af077f9b800 for lustre-MDT0000 00000100:00100000:1.0:1787115045.878748:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115045.878798:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624648192:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787115045.879028:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787115045.879157:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624648448:0@lo:9:umount.0 00000100:00100000:2.0:1787115045.879182:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787115045.879317:0:12804:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8af05916b380) has no exports 00000100:00100000:0.0:1787115045.879425:0:11900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624648320 00000100:00100000:0.0:1787115045.879431:0:11900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624648320 00000100:00100000:0.0:1787115045.879467:0:11900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624648448 00000100:00100000:0.0:1787115045.879470:0:11900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624648448 00000100:00100000:0.0:1787115045.879493:0:11900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787115045.879500:0:11900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1873925624648320:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787115045.879527:0:11900:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c81c9 00000100:00080000:0.0:1787115045.879534:0:11900:0:(import.c:65:import_set_state_nolock()) ffff8af077f14000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787115045.879567:0:11900:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787115045.879748:0:11900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3305:x1873925624648320:12345-0@lo:9:umount.0 Request processed in 247us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115045.879755:0:11900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787115045.879782:0:11900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787115045.879789:0:11900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1873925624648448:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787115045.879802:0:11900:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c82b0 00000100:00080000:0.0:1787115045.879808:0:11900:0:(import.c:65:import_set_state_nolock()) ffff8af06f4ba800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1787115045.879925:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af07b224000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787115045.879947:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787115045.879950:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787115045.879953:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624648320:0@lo:9:umount.0 00000001:00000004:0.0:1787115045.880258:0:11900:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787115045.880487:0:11900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3305:x1873925624648448:12345-0@lo:9:umount.0 Request processed in 698us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115045.880494:0:11900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787115045.880516:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af045130800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787115045.880520:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787115045.880521:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787115045.880524:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624648448:0@lo:9:umount.0 00010000:00010000:2.0:1787115045.880721:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115045.880727:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787115045.880737:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624648064 00000100:00100000:2.0:1787115045.880741:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624648064 00000100:00100000:2.0:1787115045.881042:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787115045.881051:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6bfcc0b7-8035-40e1-91c8-e687d170788c+15:3307:x1873925624648064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787115045.881312:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115045.881330:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af042cb2c00/0x194cd781e88c8588 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x194cd781e88c8581 expref: 15 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115045.881345:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115045.881416:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6bfcc0b7-8035-40e1-91c8-e687d170788c+14:3307:x1873925624648064:12345-0@lo:103:ldlm_bl.0 Request processed in 366us (2667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115045.881423:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787115045.881577:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6bfcc0b7-8035-40e1-91c8-e687d170788c:3307:1873925624648064:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1787115045.890497:0:12804:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8af05916b380) has no exports 00000020:00000080:3.0:1787115046.004708:0:12804:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c808e 00000020:00000080:3.0:1787115046.004725:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af06e903800/lustre-QMT0000_UUID 00000020:01000000:3.0:1787115046.004750:0:12804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787115046.004847:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8af06e903800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787115046.009022:0:12804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787115046.009042:0:12804:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787115046.009047:0:12804:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8af0483c3380) has no exports 00000020:00000080:2.0:1787115046.017732:0:12804:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c8087 00000020:00000080:2.0:1787115046.017745:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af074a1d000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787115046.018442:0:12804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787115046.018454:0:12804:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787115046.018458:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af074a1b800/lustre-QMT0000_UUID 00000020:00000080:2.0:1787115046.018461:0:12804:0:(genops.c:865:class_export_destroy()) destroying export ffff8af074a1b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787115046.018474:0:12804:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1787115046.018944:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8af074a1d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787115046.035201:0:12804:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8af0507ac780 - data ffff8af07fcc0a20/ffff8af0759c2000 00000020:01000000:0.0:1787115046.035352:0:12804:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8af047efc420 - data ffff8af06bf95af8/ffff8af07b2ef800 00000001:00000004:1.0:1787115046.068203:0:12804:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:1.0:1787115046.228031:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787115046.344830:0:12804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787115046.344842:0:12804:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787115046.344860:0:12804:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787115046.344863:0:12804:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787115046.347651:0:6835:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787115046.347660:0:6835:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1787115046.347673:0:6835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787115046.348660:0:12804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787115046.348666:0:12804:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1787115046.348684:0:12804:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787115046.348686:0:12804:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787115046.348835:0:7773:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787115046.348838:0:7773:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1787115046.348847:0:7773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000001:00100000:2.0:1787115046.448944:0:6604:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787115046.448954:0:6604:0:(genops.c:906:class_export_put()) final put ffff8af077f15000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787115046.448998:0:6604:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6aef9ffe-3b7b-498c-9a5a-a012c6970297 00000020:00000080:2.0:1787115046.449001:0:6604:0:(genops.c:906:class_export_put()) final put ffff8af043121000/6aef9ffe-3b7b-498c-9a5a-a012c6970297 00000020:00000080:3.0:1787115046.449209:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8af077f15000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787115046.449253:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8af043121000/6aef9ffe-3b7b-498c-9a5a-a012c6970297 for lustre-OST0000 00000020:00000080:3.0:1787115046.449272:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af077f14000 for lustre-OST0000 00000020:00000080:3.0:1787115046.449277:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af043120000 for lustre-OST0000 00000020:00000080:1.0:1787115046.475750:0:12804:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c8056 00000020:00000080:1.0:1787115046.475764:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af047e7d000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787115046.477296:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8af047e7d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787115046.479971:0:12804:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c806b 00000020:00000080:1.0:1787115046.479986:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af047e7a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787115046.480002:0:12804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787115046.480007:0:12804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787115046.480016:0:12804:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787115046.480021:0:12804:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff8af0591699c0) has no exports 00000020:00000080:2.0:1787115046.480398:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8af047e7a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1787115046.480733:0:12804:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787115046.480744:0:12804:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c82a9 00000020:00000080:1.0:1787115046.480750:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af06f418800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787115046.480769:0:12804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787115046.480775:0:12804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787115046.480782:0:12804:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787115046.480786:0:12804:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff8af042ccb380) has no exports 00000020:00000080:1.0:1787115046.480794:0:12804:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c82a2 00000020:00000080:1.0:1787115046.480798:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af045132000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787115046.481079:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8af06f418800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787115046.481089:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8af045132000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787115046.482043:0:12804:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787115046.482384:0:12804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787115046.482389:0:12804:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1787115046.482395:0:12804:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787115046.482397:0:12804:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787115046.482630:0:12804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787115046.482642:0:12804:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787115046.482651:0:12804:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c81c2 00000020:00000080:1.0:1787115046.482658:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af077cc1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787115046.482664:0:12804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787115046.482670:0:12804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787115046.482673:0:12804:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787115046.482677:0:12804:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff8af0513019c0) has no exports 00000020:00000080:1.0:1787115046.482683:0:12804:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c81bb 00000020:00000080:1.0:1787115046.482686:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af07b227800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787115046.482990:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af045130800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787115046.482998:0:38:0:(genops.c:906:class_export_put()) final put ffff8af045134800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787115046.483001:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8af045134800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787115046.483007:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787115046.483450:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8af077cc1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787115046.483457:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8af07b227800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787115046.483961:0:12804:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787115046.483965:0:12804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787115046.483969:0:12804:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1787115046.483974:0:12804:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787115046.483975:0:12804:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787115046.484704:0:12804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787115046.484715:0:12804:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787115046.484741:0:12804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787115046.484756:0:12804:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787115046.484761:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af07adca800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787115046.484764:0:12804:0:(genops.c:865:class_export_destroy()) destroying export ffff8af07adca800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787115046.484770:0:12804:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787115046.485083:0:12804:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c8072 00000020:00000080:1.0:1787115046.485091:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af047e7b800/lustre-MDD0000_UUID 00000020:00000080:2.0:1787115046.485682:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af07b224000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787115046.485691:0:38:0:(genops.c:906:class_export_put()) final put ffff8af077cc4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787115046.485694:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8af077cc4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787115046.485700:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787115046.485755:0:12804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787115046.485761:0:12804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787115046.485768:0:12804:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787115046.485771:0:12804:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8af059168000) has no exports 00000020:00000080:1.0:1787115046.485792:0:12804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787115046.485794:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8af047e7b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787115046.485796:0:12804:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787115046.485798:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af047e7f800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787115046.485800:0:12804:0:(genops.c:865:class_export_destroy()) destroying export ffff8af047e7f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787115046.485803:0:12804:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787115046.486023:0:12804:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c8079 00000020:00000080:1.0:1787115046.486028:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af047e78000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787115046.486304:0:12804:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8af05032f000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787115046.486309:0:12804:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af05032f000 3 00000020:01000004:1.0:1787115046.486312:0:12804:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8af05032f000 from lustre-MDT0000 00000020:00000080:1.0:1787115046.486332:0:12804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787115046.486337:0:12804:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787115046.486339:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af047e7e800/lustre-MDT0000_UUID 00000020:00000080:1.0:1787115046.486341:0:12804:0:(genops.c:865:class_export_destroy()) destroying export ffff8af047e7e800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787115046.486348:0:12804:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787115046.486376:0:12804:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1787115046.486379:0:12804:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787115046.486382:0:12804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787115046.486384:0:12804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787115046.486386:0:12804:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787115046.486392:0:12804:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8af059513800 6bfcc0b7-8035-40e1-91c8-e687d170788c 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787115046.486397:0:12804:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8af051303380) has exports, disconnecting them 00000020:00080000:1.0:1787115046.486409:0:12804:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8af059513800), last request at 1787114802 00000020:00000080:1.0:1787115046.486423:0:12804:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c8017 00000020:00010000:1.0:1787115046.486426:0:12804:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8af059513800: total 1 00000100:00080000:1.0:1787115046.486430:0:12804:0:(import.c:65:import_set_state_nolock()) ffff8af054a88000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787115046.486448:0:12804:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8af059513800): rc 0 00000020:00080000:1.0:1787115046.486452:0:12804:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8af051303380) has no exports 00000020:00010000:1.0:1787115046.486529:0:5773:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8af059513800: total 1 00010000:00010000:1.0:1787115046.486693:0:5773:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8af059513800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787115046.486720:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af041682800/0x194cd781e88c812f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x194cd781e88c8128 expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115046.486742:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af042cb3800/0x194cd781e88c857a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x194cd781e88c8573 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115046.486753:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af0429ca800/0x194cd781e88c8319 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x194cd781e88c8312 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115046.486765:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af042cb3e00/0x194cd781e88c8327 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x194cd781e88c8320 expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115046.486775:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af052365c00/0x194cd781e88c8335 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x194cd781e88c832e expref: 5 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115046.486785:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af0429cb600/0x194cd781e88c8343 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x194cd781e88c833c expref: 4 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115046.486795:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af052365a00/0x194cd781e88c836d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x194cd781e88c8366 expref: 3 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115046.486807:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af052364a00/0x194cd781e88c856c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x194cd781e88c8565 expref: 2 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787115046.486847:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8af047e78000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1787115046.486938:0:5773:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8af059513800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1787115046.486953:0:5773:0:(genops.c:906:class_export_put()) final put ffff8af059513800/6bfcc0b7-8035-40e1-91c8-e687d170788c 00010000:00010000:1.0:1787115046.486969:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115046.486972:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115046.486974:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787115046.487026:0:5779:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8af0512aca00:5779] 1 exiting: rc = 0 00000100:00100000:2.0:1787115046.487173:0:5778:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8af045665800:5778] 0 exiting: rc = 1 00000100:00100000:2.0:1787115046.487224:0:5780:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8af0512ade00:5780] 2 exiting: rc = 0 00000020:00000080:2.0:1787115046.487257:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8af059513800/6bfcc0b7-8035-40e1-91c8-e687d170788c for MGS 00000020:00000080:2.0:1787115046.487276:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af054a88000 for MGS 00000100:00100000:1.0:1787115046.487333:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487340:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487347:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487353:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487358:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487364:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487371:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487376:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487382:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487388:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487394:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487400:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487405:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487412:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487417:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487422:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487427:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487433:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487438:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487444:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487449:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487454:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487459:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487465:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487472:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487478:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487492:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487498:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487503:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487508:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487514:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487519:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487524:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487530:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487670:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487675:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487680:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487685:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487690:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487696:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487701:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487706:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487712:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487717:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487723:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487729:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487734:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487740:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487745:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487750:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487756:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487761:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487767:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487772:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487778:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487783:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487788:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487793:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487799:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487804:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487810:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487957:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487963:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.487968:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1787115046.488905:0:12804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787115046.488911:0:12804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1787115046.490242:0:12804:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8af0621cfba0 - data ffff8af07fc1dd80/ffff8af0590b4400 00000020:01000000:1.0:1787115046.490397:0:12804:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8af05925dc00 - data ffff8af06bf8d510/ffff8af045168400 00000020:00000080:1.0:1787115046.491813:0:12804:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c7ffb 00000020:00000080:1.0:1787115046.491822:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af054525800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787115046.491841:0:12804:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8af05032f000 from MGS, refs=2 00000020:01000004:1.0:1787115046.491844:0:12804:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af05032f000 2 00000020:01000004:1.0:1787115046.491847:0:12804:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8af05032f000 from MGS 00000020:00000080:1.0:1787115046.491870:0:12804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787115046.491877:0:12804:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787115046.491880:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af04511c000/MGS 00000020:00000080:1.0:1787115046.491882:0:12804:0:(genops.c:865:class_export_destroy()) destroying export ffff8af04511c000/MGS for MGS 00000020:01000000:1.0:1787115046.491892:0:12804:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787115046.491945:0:12804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787115046.491949:0:12804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787115046.491954:0:12804:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787115046.491961:0:12804:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8af06e907800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787115046.491966:0:12804:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff8af042cc99c0) has exports, disconnecting them 00000020:00080000:1.0:1787115046.491971:0:12804:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8af06e907800), last request at 1787114803 00000020:00000080:1.0:1787115046.491975:0:12804:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c80c6 00000020:00080000:1.0:1787115046.491986:0:12804:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8af06e907800): rc 0 00000020:00000080:1.0:1787115046.491990:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af06e907800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787115046.492062:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8af054525800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787115046.492081:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8af06e907800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787115046.501198:0:12804:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787115046.501208:0:12804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787115046.501212:0:12804:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787115046.501220:0:12804:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787115046.501401:0:12804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787115046.501419:0:12804:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787115046.501427:0:12804:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af05032f000 1 00000020:00000080:2.0:1787115046.501433:0:12804:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c7fed 00000020:00000080:2.0:1787115046.501442:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af04511a800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787115046.503451:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af06e906800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787115046.512059:0:8:0:(genops.c:906:class_export_put()) final put ffff8af047e7d800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787115046.512070:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8af047e7d800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787115046.512079:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1787115046.512594:0:12804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787115046.512636:0:12804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787115046.512646:0:12804:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787115046.512651:0:12804:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8af0483c19c0) has no exports 00000020:00000080:3.0:1787115046.512696:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8af04511a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787115046.706276:0:12804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787115046.706302:0:12804:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787115046.706308:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af05032f800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787115046.706314:0:12804:0:(genops.c:865:class_export_destroy()) destroying export ffff8af05032f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787115046.706325:0:12804:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787115046.706460:0:12804:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8af05032a800 00000020:01000000:1.0:1787115046.706500:0:12804:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787115046.706503:0:12804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787115046.706508:0:12804:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787115046.706512:0:12804:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff8af051300000) has no exports 00000100:00100000:1.0:1787115046.709275:0:7216:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8af059011400:7216] 3 exiting: rc = 0 00000100:00100000:0.0:1787115046.710399:0:5787:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8af0512ae800:5787] 2 exiting: rc = 0 00000100:00100000:1.0:1787115046.713223:0:5786:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8af042cc3600:5786] 1 exiting: rc = 0 00000100:00100000:3.0:1787115046.715343:0:5785:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8af042cc2c00:5785] 0 exiting: rc = 1 00000100:00100000:1.0:1787115046.715988:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.715997:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716002:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716008:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716013:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716019:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716024:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716030:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716035:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716040:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716067:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716075:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716083:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716089:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716097:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716102:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716128:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716134:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716140:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716145:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716149:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716154:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716159:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716164:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716171:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716176:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716180:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716186:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716200:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716206:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716211:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716216:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716220:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716226:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716230:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716235:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716240:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716244:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716249:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716256:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716261:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716266:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716270:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716275:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716280:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716406:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716412:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716416:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716421:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716425:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716430:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716435:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716439:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716444:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716449:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716453:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716457:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716462:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716474:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716492:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716498:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716503:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716509:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.716519:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115046.725345:0:5788:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8af0512af800:5788] 0 exiting: rc = 1 00000100:00100000:3.0:1787115046.726562:0:5789:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8af0512afe00:5789] 1 exiting: rc = 0 00000100:00100000:1.0:1787115046.726665:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726681:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726691:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726700:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726704:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726708:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726716:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726722:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726728:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726734:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726741:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726746:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726754:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726760:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726773:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726777:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726781:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726784:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726788:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726791:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726795:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726797:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726801:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726804:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726807:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726809:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726812:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726820:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726823:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726826:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726830:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726833:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726837:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726840:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726849:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726853:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726856:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726860:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726863:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726866:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726869:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726872:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726875:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726878:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726883:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726888:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726893:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726898:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726903:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726908:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726913:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726918:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726923:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726929:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726935:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726940:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726946:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726952:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726956:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726960:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726965:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726970:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726976:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.726980:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115046.728234:0:5791:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8af066479400:5791] 1 exiting: rc = 0 00000100:00100000:3.0:1787115046.728279:0:5790:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8af0431f6200:5790] 0 exiting: rc = 1 00000100:00100000:1.0:1787115046.728385:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728392:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728397:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728402:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728408:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728427:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728436:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728441:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728449:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728457:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728464:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728494:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728501:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728507:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728525:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728557:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728567:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728575:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728583:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728589:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728595:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728643:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728650:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728657:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728664:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728673:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728681:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728714:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728721:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728728:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728733:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728740:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728746:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728781:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728790:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728797:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728806:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728815:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728823:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728852:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728867:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728873:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728924:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728931:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728935:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728944:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728954:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728961:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728966:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728977:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.728985:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.729004:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.729009:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.729013:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.729018:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.729023:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.729027:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.729032:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.729042:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.729051:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.729058:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.729066:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.729073:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.729088:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115046.740514:0:5793:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8af0431f7e00:5793] 1 exiting: rc = 0 00000100:00100000:3.0:1787115046.740516:0:5792:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8af0431f6000:5792] 0 exiting: rc = 1 00000100:00100000:0.0:1787115046.740712:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740718:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740721:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740726:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740739:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740742:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740746:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740750:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740753:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740756:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740760:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740763:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740766:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740769:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740771:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740774:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740777:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740779:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740783:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740785:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740788:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740791:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740793:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740796:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740799:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740802:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740805:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740808:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740810:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740814:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740818:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740823:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740827:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740831:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740836:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740840:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740845:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740849:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740855:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740866:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740870:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740874:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740877:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740958:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740962:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740965:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740969:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740972:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740975:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740978:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740981:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740990:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740993:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.740997:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741000:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741003:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741006:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741010:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741013:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741016:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741019:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741022:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741025:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741029:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787115046.741452:0:5795:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8af073452400:5795] 1 exiting: rc = 0 00000100:00100000:1.0:1787115046.741453:0:5794:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8af066479200:5794] 0 exiting: rc = 1 00000100:00100000:0.0:1787115046.741548:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741554:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741559:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741564:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741570:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741575:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741581:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741585:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741589:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741592:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741620:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741623:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741627:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741630:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741634:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741637:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741640:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741644:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741647:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741650:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741653:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741656:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741659:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741662:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741665:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741667:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741670:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741673:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741675:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741678:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741681:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741684:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741687:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741690:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741693:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741696:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741699:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741702:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741705:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741707:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741710:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741713:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741716:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741718:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741721:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741729:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741732:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741735:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741738:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741741:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741744:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741747:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741750:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741753:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741756:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741759:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741762:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741765:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741768:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741771:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741773:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741777:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741780:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.741783:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787115046.742197:0:5797:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8af073453e00:5797] 1 exiting: rc = 0 00000100:00100000:2.0:1787115046.742231:0:5796:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8af0734c8800:5796] 0 exiting: rc = 1 00000100:00100000:0.0:1787115046.742283:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742290:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742295:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742300:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742305:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742309:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742314:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742319:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742326:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742331:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742336:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742341:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742347:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742352:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742357:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742361:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742375:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742380:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742384:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742388:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742391:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742394:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742398:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742401:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742403:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742406:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742409:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742413:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742416:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742419:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742422:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742425:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742428:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742431:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742434:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742437:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742439:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742443:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742447:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742449:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742452:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742455:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742458:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742461:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742464:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742467:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742470:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742473:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742476:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742479:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742482:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742489:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742492:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742495:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742499:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742501:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742504:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742507:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742510:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742513:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742517:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742520:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742523:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.742526:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115046.742955:0:5799:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8af073526600:5799] 1 exiting: rc = 0 00000100:00100000:0.0:1787115046.743280:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8af0734c8600:5800] 2 exiting: rc = 0 00000100:00100000:1.0:1787115046.743875:0:5798:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8af045104e00:5798] 0 exiting: rc = 1 00000100:00100000:0.0:1787115046.744255:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744260:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744264:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744275:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744280:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744291:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744295:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744299:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744304:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744308:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744312:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744316:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744320:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744333:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744338:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744341:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744347:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744350:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744354:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744358:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744362:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744372:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744375:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744379:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744383:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744386:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744390:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744393:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744397:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744401:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744405:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744408:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744412:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744415:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744419:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744422:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744426:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744438:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744442:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744446:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744450:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744453:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744457:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744461:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744465:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744468:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744471:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744475:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744478:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744482:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744486:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744490:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744494:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744498:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744502:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744506:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744514:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744517:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744521:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744525:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744538:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744542:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744546:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787115046.744549:0:12804:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787115046.750629:0:12804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787115046.750641:0:12804:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787115046.750646:0:12804:0:(genops.c:906:class_export_put()) final put ffff8af042f7d000/MDS_uuid 00000020:00000080:1.0:1787115046.750650:0:12804:0:(genops.c:865:class_export_destroy()) destroying export ffff8af042f7d000/MDS_uuid for MDS 00000020:01000000:1.0:1787115046.750654:0:12804:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787115046.751033:0:12804:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787115047.241215:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115048.261299:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115049.286205:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787115049.959792:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787115049.959805:0:7483:0:(genops.c:906:class_export_put()) final put ffff8af06f4bc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787115049.959868:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8af06f4bc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787115049.959929:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af06f4ba800 for lustre-OST0001 00010000:00010000:0.0:1787115050.311456:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787115050.398575:0:12956:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787115050.423292:0:12956:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787115050.423344:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052364200/0x194cd781e88c832e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8335 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115050.423360:0:12956:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052364200/0x194cd781e88c832e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8335 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115050.423368:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052364200/0x194cd781e88c832e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c8335 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115050.423375:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff8af052364200/0x194cd781e88c832e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c8335 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115050.423394:0:12956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787115050.423401:0:12956:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787115050.423424:0:12956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787115050.423428:0:12956:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787115050.423433:0:12956:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787115050.423482:0:12956:0:(import.c:65:import_set_state_nolock()) ffff8af077f9a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787115050.423624:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1873925624648576:0@lo:39:umount.0 00000400:00000100:1.0:1787115050.423692:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873925624648576 offset 0 length 224: 4 00010000:00010000:0.0:1787115050.423970:0:8290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787115050.423978:0:8290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af052364200/0x194cd781e88c832e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c8335 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115050.423986:0:8290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364200 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:0.0:1787115050.423990:0:8290:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af052364200/0x194cd781e88c832e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c8335 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115050.424000:0:8290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af052364200/0x194cd781e88c832e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x194cd781e88c8335 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787115050.424009:0:8290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af052364200/0x194cd781e88c832e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x194cd781e88c8335 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787115050.424015:0:8290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787115050.424018:0:8290:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787115050.424021:0:8290:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787115050.424051:0:8290:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af052364200/0x194cd781e88c832e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x194cd781e88c8335 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115050.424068:0:8290:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787115050.424191:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624648704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787115050.424232:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115050.424320:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624648704 00000100:00100000:3.0:1787115050.424330:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624648704 00000100:00100000:3.0:1787115050.424378:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787115050.424386:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1873925624648704:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787115050.424393:0:5771:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787115050 with bad export cookie 1823068902130483223 00010000:00010000:0.0:1787115050.428160:0:8290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af052364200/0x194cd781e88c832e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x194cd781e88c8335 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115050.428187:0:8290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af052364200/0x194cd781e88c832e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x194cd781e88c8335 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115050.428217:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115050.428220:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115050.428224:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787115050.462003:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1873925624648704:12345-0@lo:103:ldlm_bl.0 Request processed in 37605us (37759us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787115050.462022:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787115050.462153:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.110@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787115050.462160:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8af059175000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787115050.462164:0:3308:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.110@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1787115050.485638:0:3308:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.110@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787115050.485646:0:3308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787115050.485659:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8af06f634000 x1873925624648704/t0(0) o103->MGC192.168.202.110@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787115066 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787115050.485675:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787115050.485679:0:3308:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787115050.485680:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787115050.485685:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8af059175000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787115050.485691:0:3308:0:(import.c:510:import_select_connection()) MGC192.168.202.110@tcp: connect to NID 0@lo last attempt 131 00000100:00080000:0.0:1787115050.485702:0:3308:0:(import.c:624:import_select_connection()) MGC192.168.202.110@tcp: import ffff8af059175000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:1.0:1787115050.486016:0:3308:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af07f7e5880 x1873925624648832/t0(0) o250->MGC192.168.202.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787115050.486062:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6bfcc0b7-8035-40e1-91c8-e687d170788c:3308:1873925624648704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787115050.486221:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6bfcc0b7-8035-40e1-91c8-e687d170788c:3305:1873925624648832:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1787115050.486276:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1873925624648832 offset 0 length 520: 4 00000100:00100000:3.0:1787115050.885779:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787115050.885935:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624648960:0@lo:400:kworker.0 00000400:00000100:3.0:1787115050.885993:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873925624648960 offset 0 length 224: 4 00010000:00010000:2.0:1787115051.335304:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115052.357590:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115053.381549:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115054.410305:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115055.433593:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787115056.006279:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6bfcc0b7-8035-40e1-91c8-e687d170788c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787115056.006292:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6bfcc0b7-8035-40e1-91c8-e687d170788c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787115056.006556:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787115056.006584:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873925624649088:0@lo:400:kworker.0 00000400:00000100:1.0:1787115056.006659:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873925624649088 offset 0 length 224: 4 00010000:00010000:1.0:1787115056.459184:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115057.477797:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115058.502016:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115059.525575:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115060.549750:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787115060.613228:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787115050/real 1787115050] req@ffff8af07f7e5880 x1873925624648832/t0(0) o250->MGC192.168.202.110@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787115060 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787115060.613271:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8af07f7e5880 x1873925624648832/t0(0) o250->MGC192.168.202.110@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787115060 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787115060.613283:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787115050/real 1787115050] req@ffff8af07f6c0a80 x1873925624648576/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787115060 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787115060.613333:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8af07f6c0a80 x1873925624648576/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787115060 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787115060.613356:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af059175000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787115060.613393:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1787115060.613398:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6bfcc0b7-8035-40e1-91c8-e687d170788c:3305:1873925624648832:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1787115060.613405:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af077f9a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787115060.613434:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1873925624648576:0@lo:39:umount.0 00000100:00080000:2.0:1787115060.613894:0:12956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787115060.613900:0:12956:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787115060.613906:0:12956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787115060.615907:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6bfcc0b7-8035-40e1-91c8-e687d170788c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787115060.615942:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787115060.615946:0:38:0:(import.c:65:import_set_state_nolock()) ffff8af059175000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787115060.615955:0:38:0:(import.c:510:import_select_connection()) MGC192.168.202.110@tcp: connect to NID 0@lo last attempt 379 00000100:00080000:0.0:1787115060.615963:0:38:0:(import.c:589:import_select_connection()) MGC192.168.202.110@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787115060.615973:0:38:0:(import.c:624:import_select_connection()) MGC192.168.202.110@tcp: import ffff8af059175000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1787115060.616018:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af06f636a00 x1873925624649216/t0(0) o250->MGC192.168.202.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787115060.616139:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787115060.616161:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624649344:0@lo:400:kworker.0 00000400:00000100:0.0:1787115060.616229:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873925624649344 offset 0 length 224: 4 00000100:00100000:3.0:1787115060.617753:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6bfcc0b7-8035-40e1-91c8-e687d170788c:3305:1873925624649216:0@lo:250:kworker.0 00000400:00000100:3.0:1787115060.617819:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1873925624649216 offset 0 length 520: 4 00010000:00010000:2.0:1787115060.626323:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c833c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8343 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115060.626351:0:12956:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c833c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8343 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115060.626372:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c833c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c8343 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115060.626380:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c833c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c8343 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115060.626421:0:12956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787115060.627295:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787115060.627309:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c833c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c8343 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115060.627319:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052365e00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:0.0:1787115060.627323:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c833c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c8343 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115060.627334:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c833c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x194cd781e88c8343 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787115060.627342:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c833c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x194cd781e88c8343 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787115060.627349:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787115060.627352:0:5773:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1787115060.627615:0:5773:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8af059175000 00010000:00010000:0.0:1787115060.627620:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c833c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x194cd781e88c8343 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115060.627654:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115060.627656:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115060.627658:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115060.629285:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af052365e00/0x194cd781e88c833c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x194cd781e88c8343 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115060.629321:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af042cb3200/0x194cd781e88c8573 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c857a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115060.629351:0:12956:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af042cb3200/0x194cd781e88c8573 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c857a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115060.629358:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af042cb3200/0x194cd781e88c8573 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c857a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115060.629378:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff8af042cb3200/0x194cd781e88c8573 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c857a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115060.629413:0:12956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787115060.629420:0:12956:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1787115060.629427:0:12956:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1787115060.631162:0:12956:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00010000:00010000:0.0:1787115060.631627:0:8290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787115060.631640:0:8290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af042cb3200/0x194cd781e88c8573 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c857a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115060.631653:0:8290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3200 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:0.0:1787115060.631658:0:8290:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af042cb3200/0x194cd781e88c8573 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c857a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115060.631673:0:8290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af042cb3200/0x194cd781e88c8573 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x194cd781e88c857a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787115060.631682:0:8290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af042cb3200/0x194cd781e88c8573 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x194cd781e88c857a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787115060.631689:0:8290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787115060.631692:0:8290:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787115060.631696:0:8290:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787115060.631718:0:8290:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8af059175000 00010000:00010000:0.0:1787115060.631722:0:8290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af042cb3200/0x194cd781e88c8573 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x194cd781e88c857a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115060.631729:0:8290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af042cb3200/0x194cd781e88c8573 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x194cd781e88c857a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115060.631746:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115060.631748:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115060.632295:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787115060.633376:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1787115060.633391:0:12956:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787115060.633410:0:12956:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787115060.633417:0:12956:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8af051304d40) has no exports 00000020:00080000:2.0:1787115060.634592:0:12956:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8af051304d40) has no exports 00000020:01000000:2.0:1787115060.652019:0:12956:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8af0621cfde0 - data ffff8af0668ad798/ffff8af0590b7800 00000020:01000000:2.0:1787115060.652226:0:12956:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8af047332c00 - data ffff8af06bf870d8/ffff8af077f84000 00100000:10000000:3.0:1787115060.685984:0:12956:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787115060.769041:0:12956:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c814b 00000020:00000080:0.0:1787115060.769058:0:12956:0:(genops.c:906:class_export_put()) final put ffff8af077cc7800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787115060.769082:0:12956:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8af06f41d000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787115060.769086:0:12956:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af06f41d000 2 00000020:01000004:0.0:1787115060.769090:0:12956:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8af06f41d000 from lustre-OST0000 00000020:00000080:3.0:1787115060.769488:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8af077cc7800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787115060.775033:0:12956:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787115060.775058:0:12956:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787115060.775080:0:12956:0:(genops.c:906:class_export_put()) final put ffff8af07b222000/lustre-OST0000_UUID 00000020:00000080:1.0:1787115060.775086:0:12956:0:(genops.c:865:class_export_destroy()) destroying export ffff8af07b222000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787115060.775126:0:12956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1787115060.775222:0:12956:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787115060.775229:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787115060.775235:0:12956:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787115060.775241:0:12956:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787115060.775249:0:12956:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8af077f98800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787115060.775257:0:12956:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff8af0483c4d40) has exports, disconnecting them 00000020:00080000:1.0:1787115060.775262:0:12956:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8af077f98800), last request at 1787114819 00000020:00000080:1.0:1787115060.775268:0:12956:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c8175 00000020:00080000:1.0:1787115060.775295:0:12956:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8af077f98800): rc 0 00000020:00000080:1.0:1787115060.775303:0:12956:0:(genops.c:906:class_export_put()) final put ffff8af077f98800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787115060.775629:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8af077f98800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787115060.788994:0:12956:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787115060.789011:0:12956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787115060.789017:0:12956:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787115060.789027:0:12956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787115060.789078:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af077f9a800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787115060.789305:0:12956:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787115060.789317:0:12956:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787115060.789323:0:12956:0:(genops.c:906:class_export_put()) final put ffff8af073aaa000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787115060.789327:0:12956:0:(genops.c:865:class_export_destroy()) destroying export ffff8af073aaa000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787115060.789334:0:12956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1787115060.789442:0:12956:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af06f41d000 1 00000020:00000080:3.0:1787115060.789451:0:12956:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c8105 00000020:00000080:3.0:1787115060.789483:0:12956:0:(genops.c:906:class_export_put()) final put ffff8af051284000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787115060.789495:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787115060.789505:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8af051284000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787115060.789515:0:12956:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787115060.789521:0:12956:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787115060.789526:0:12956:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8af0483c0000) has no exports 00000020:00000080:3.0:1787115060.882606:0:12956:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787115060.882641:0:12956:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787115060.882651:0:12956:0:(genops.c:906:class_export_put()) final put ffff8af06f41f000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787115060.882657:0:12956:0:(genops.c:865:class_export_destroy()) destroying export ffff8af06f41f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787115060.882672:0:12956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787115060.882836:0:12956:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8af06f41a800 00000020:02000400:3.0:1787115060.882904:0:12956:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787115061.575959:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115062.599527:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115063.627801:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115064.659750:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787115064.840689:0:13109:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787115064.851253:0:13109:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787115064.851330:0:13109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af042cb2000/0x194cd781e88c8312 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8319 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115064.851345:0:13109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af042cb2000/0x194cd781e88c8312 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8319 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115064.851353:0:13109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af042cb2000/0x194cd781e88c8312 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c8319 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115064.851360:0:13109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff8af042cb2000/0x194cd781e88c8312 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c8319 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115064.851381:0:13109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787115064.851387:0:13109:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787115064.851411:0:13109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787115064.851422:0:13109:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8af07f7e7100 x1873925624648960/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787115066 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787115064.851461:0:13109:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8af0513abb80 x1873925624649088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787115072 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787115064.851477:0:13109:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8af06f636680 x1873925624649344/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787115076 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787115064.851486:0:13109:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1787115064.851518:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873925624649088:0@lo:400:kworker.0 00000100:00080000:1.0:1787115064.851545:0:13109:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787115064.851573:0:13109:0:(import.c:65:import_set_state_nolock()) ffff8af06f295800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787115064.851724:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115064.851734:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af042cb2000/0x194cd781e88c8312 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c8319 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115064.851743:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2000 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1787115064.851747:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af042cb2000/0x194cd781e88c8312 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c8319 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115064.851777:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af042cb2000/0x194cd781e88c8312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x194cd781e88c8319 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787115064.851785:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af042cb2000/0x194cd781e88c8312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x194cd781e88c8319 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787115064.851792:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787115064.851795:0:5774:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787115064.851797:0:5774:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787115064.851811:0:5774:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8af059175000 00010000:00010000:2.0:1787115064.851815:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af042cb2000/0x194cd781e88c8312 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x194cd781e88c8319 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115064.851821:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af042cb2000/0x194cd781e88c8312 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x194cd781e88c8319 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115064.851832:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115064.851834:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115064.851836:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787115064.851871:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624649344:0@lo:400:kworker.0 00000100:00100000:0.0:1787115064.851939:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624648960:0@lo:400:kworker.0 00000100:00100000:3.0:1787115064.852725:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1873925624649472:0@lo:39:umount.0 00000400:00000100:3.0:1787115064.852785:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873925624649472 offset 0 length 224: 4 00010000:00010000:1.0:1787115065.672933:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787115065.739724:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6bfcc0b7-8035-40e1-91c8-e687d170788c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787115065.739744:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6bfcc0b7-8035-40e1-91c8-e687d170788c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787115066.697510:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115067.719446:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115068.741252:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115069.765406:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115070.790567:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787115070.853739:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6bfcc0b7-8035-40e1-91c8-e687d170788c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787115070.853748:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6bfcc0b7-8035-40e1-91c8-e687d170788c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787115071.814718:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115072.842079:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115073.866949:0:8291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787115074.053298:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787115064/real 1787115064] req@ffff8af07f7e4e00 x1873925624649472/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787115074 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787115074.053332:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8af07f7e4e00 x1873925624649472/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787115074 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787115074.053381:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af06f295800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787115074.053404:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1873925624649472:0@lo:39:umount.0 00000100:00080000:1.0:1787115074.053555:0:13109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787115074.053560:0:13109:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787115074.053565:0:13109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787115074.054562:0:13109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429cb400/0x194cd781e88c8320 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c8327 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115074.054577:0:13109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429cb400/0x194cd781e88c8320 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c8327 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115074.054585:0:13109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429cb400/0x194cd781e88c8320 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c8327 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115074.054591:0:13109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff8af0429cb400/0x194cd781e88c8320 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c8327 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115074.054618:0:13109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787115074.054625:0:13109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8565 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c856c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115074.054631:0:13109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8565 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c856c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115074.054638:0:13109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8565 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c856c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115074.054644:0:13109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8565 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x194cd781e88c856c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115074.054665:0:13109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787115074.054670:0:13109:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787115074.054704:0:13109:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787115074.054709:0:13109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787115074.054713:0:13109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787115074.054719:0:13109:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787115074.054724:0:13109:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8af06eeab380) has no exports 00000020:00080000:1.0:1787115074.054749:0:13109:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8af06eeab380) has no exports 00010000:00010000:2.0:1787115074.056483:0:8290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787115074.056496:0:8290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af0429cb400/0x194cd781e88c8320 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c8327 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115074.056507:0:8290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cb400 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1787115074.056528:0:8290:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af0429cb400/0x194cd781e88c8320 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c8327 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115074.056539:0:8290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af0429cb400/0x194cd781e88c8320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x194cd781e88c8327 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787115074.056547:0:8290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af0429cb400/0x194cd781e88c8320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x194cd781e88c8327 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787115074.056553:0:8290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787115074.056556:0:8290:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1787115074.056559:0:8290:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1787115074.056575:0:8290:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8af059175000 00010000:00010000:2.0:1787115074.056579:0:8290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af0429cb400/0x194cd781e88c8320 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x194cd781e88c8327 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115074.056587:0:8290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af0429cb400/0x194cd781e88c8320 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x194cd781e88c8327 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115074.056601:0:8290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115074.056605:0:8290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8565 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c856c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115074.056612:0:8290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cb000 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1787115074.056615:0:8290:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8565 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x194cd781e88c856c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115074.056622:0:8290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8565 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x194cd781e88c856c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787115074.056628:0:8290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8565 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x194cd781e88c856c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787115074.056641:0:8290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787115074.056643:0:8290:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787115074.056645:0:8290:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787115074.056651:0:8290:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8af059175000 00010000:00010000:2.0:1787115074.056654:0:8290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8565 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x194cd781e88c856c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115074.056661:0:8290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af0429cb000/0x194cd781e88c8565 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x194cd781e88c856c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115074.056675:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115074.056677:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115074.056679:0:8290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115074.057042:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787115074.059465:0:13109:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8af0621cf960 - data ffff8af07fcbd1b0/ffff8af0590b4000 00000020:01000000:1.0:1787115074.059624:0:13109:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8af045ba7720 - data ffff8af066a4c798/ffff8af06f4b5400 00100000:10000000:1.0:1787115074.067694:0:13109:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787115074.117208:0:13109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c8216 00000020:00000080:0.0:1787115074.117220:0:13109:0:(genops.c:906:class_export_put()) final put ffff8af07fb00800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787115074.117237:0:13109:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8af07b581000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787115074.117240:0:13109:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af07b581000 2 00000020:01000004:0.0:1787115074.117244:0:13109:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8af07b581000 from lustre-OST0001 00000020:00000080:0.0:1787115074.117267:0:13109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787115074.117278:0:13109:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787115074.117280:0:13109:0:(genops.c:906:class_export_put()) final put ffff8af07fb01800/lustre-OST0001_UUID 00000020:00000080:0.0:1787115074.117283:0:13109:0:(genops.c:865:class_export_destroy()) destroying export ffff8af07fb01800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787115074.117290:0:13109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787115074.117406:0:13109:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 6bfcc0b7-8035-40e1-91c8-e687d170788c->MGS 00010000:00010000:0.0:1787115074.117430:0:13109:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af052365600/0x194cd781e88c8128 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x194cd781e88c812f expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787115074.117441:0:13109:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af052365600/0x194cd781e88c8128 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x194cd781e88c812f expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787115074.117447:0:13109:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787115074.117450:0:13109:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787115074.117453:0:13109:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787115074.117469:0:13109:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8af059175000 00010000:00010000:0.0:1787115074.117473:0:13109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af052365600/0x194cd781e88c8128 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x194cd781e88c812f expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115074.117488:0:13109:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af041682e00/0x194cd781e88c8366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x194cd781e88c836d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787115074.117495:0:13109:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af041682e00/0x194cd781e88c8366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x194cd781e88c836d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787115074.117500:0:13109:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787115074.117502:0:13109:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787115074.117503:0:13109:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787115074.117512:0:13109:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8af059175000 00010000:00010000:0.0:1787115074.117515:0:13109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af041682e00/0x194cd781e88c8366 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x194cd781e88c836d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787115074.117532:0:13109:0:(import.c:65:import_set_state_nolock()) ffff8af059175000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787115074.117536:0:13109:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787115074.117539:0:13109:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787115074.117541:0:13109:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787115074.117544:0:13109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787115074.117556:0:13109:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8af06f636a00 x1873925624649216/t0(0) o250->MGC192.168.202.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787115075 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787115074.117584:0:13109:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787115074.117587:0:13109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000020:00000080:3.0:1787115074.117697:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8af07fb00800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1787115074.117786:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6bfcc0b7-8035-40e1-91c8-e687d170788c:3305:1873925624649216:0@lo:250:kworker.0 10000000:01000000:0.0:1787115074.120407:0:13109:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787115074.120427:0:13109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c8009 00000020:00000080:0.0:1787115074.120438:0:13109:0:(genops.c:906:class_export_put()) final put ffff8af042f7c000/6bfcc0b7-8035-40e1-91c8-e687d170788c 00000020:01000000:0.0:1787115074.120461:0:13109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.110@tcp (flags='') 00000020:00000080:0.0:1787115074.120475:0:13109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787115074.120482:0:13109:0:(obd_config.c:955:class_cleanup()) MGC192.168.202.110@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787115074.120486:0:13109:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff8af05916cd40) has no exports 10000000:01000000:0.0:1787115074.120510:0:5782:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1787115074.120589:0:13109:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.110@tcp: client import never connected 00000100:00080000:0.0:1787115074.120604:0:13109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787115074.120608:0:13109:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787115074.120611:0:13109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787115074.120613:0:13109:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787115074.120657:0:13109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787115074.120663:0:13109:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.110@tcp (uuid 6bfcc0b7-8035-40e1-91c8-e687d170788c) 00000020:01000000:0.0:1787115074.120669:0:13109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787115074.120672:0:13109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787115074.120676:0:13109:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787115074.120684:0:13109:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8af06f290000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787115074.120689:0:13109:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff8af07fb24d40) has exports, disconnecting them 00000020:00080000:0.0:1787115074.120694:0:13109:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8af06f290000), last request at 1787114839 00000020:00000080:0.0:1787115074.120698:0:13109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c8240 00000020:00080000:0.0:1787115074.120710:0:13109:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8af06f290000): rc 0 00000020:00000080:0.0:1787115074.120713:0:13109:0:(genops.c:906:class_export_put()) final put ffff8af06f290000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787115074.122428:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8af042f7c000/6bfcc0b7-8035-40e1-91c8-e687d170788c for MGC192.168.202.110@tcp 00000020:00000080:3.0:1787115074.122448:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af059175000 for MGC192.168.202.110@tcp 00000020:00000080:3.0:1787115074.122456:0:8:0:(genops.c:906:class_export_put()) final put ffff8af042c50000/6bfcc0b7-8035-40e1-91c8-e687d170788c 00000020:00000080:3.0:1787115074.122459:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8af042c50000/6bfcc0b7-8035-40e1-91c8-e687d170788c for MGC192.168.202.110@tcp 00000020:01000000:3.0:1787115074.122464:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.110@tcp (6bfcc0b7-8035-40e1-91c8-e687d170788c) 00000020:00000080:3.0:1787115074.122727:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8af06f290000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1787115074.123056:0:13109:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787115074.123062:0:13109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787115074.123066:0:13109:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787115074.123071:0:13109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787115074.123203:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af06f295800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1787115074.123327:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1787115074.123580:0:8291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1787115074.125286:0:8290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1787115074.125683:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1787115074.125843:0:5769:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8af050075800:5769] 1 exiting: rc = 0 00000100:00100000:3.0:1787115074.125903:0:5768:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8af058ffb000:5768] 0 exiting: rc = 1 00000100:00100000:1.0:1787115074.125992:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.126287:0:5770:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8af050075200:5770] 0 exiting: rc = 1 00000100:00100000:3.0:1787115074.127798:0:5771:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8af050075400:5771] 1 exiting: rc = 0 00000100:00100000:3.0:1787115074.127883:0:5772:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8af050074800:5772] 2 exiting: rc = 0 00000100:00100000:3.0:1787115074.129344:0:6592:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8af077c18c00:6592] 3 exiting: rc = 0 00000100:00100000:1.0:1787115074.129858:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.129867:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.129874:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.129881:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.129887:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.129893:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.129899:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.129905:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.129910:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.129916:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.129922:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.129927:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.129933:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.129939:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.129946:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.129952:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.129991:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.129996:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130002:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130008:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130014:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130019:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130025:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130030:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130034:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130039:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130045:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130051:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130055:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130061:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130066:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130070:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130075:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130080:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130085:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130091:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130096:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130101:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130137:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130143:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130149:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130155:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130160:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130165:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130170:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130175:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130180:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130186:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130191:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130196:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130202:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130215:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130221:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130226:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130232:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130237:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130243:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130248:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130253:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130257:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130262:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130267:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130272:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.130277:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787115074.135743:0:13109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787115074.135767:0:13109:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787115074.135773:0:13109:0:(genops.c:906:class_export_put()) final put ffff8af07b583800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787115074.135779:0:13109:0:(genops.c:865:class_export_destroy()) destroying export ffff8af07b583800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787115074.135787:0:13109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1787115074.135840:0:13109:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af07b581000 1 00000020:00000080:1.0:1787115074.135846:0:13109:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x194cd781e88c81e5 00000020:00000080:1.0:1787115074.135853:0:13109:0:(genops.c:906:class_export_put()) final put ffff8af059000800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787115074.135864:0:13109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787115074.135868:0:13109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787115074.135872:0:13109:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787115074.135876:0:13109:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff8af07fb20000) has no exports 00000020:00000080:3.0:1787115074.136171:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8af059000800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787115074.182661:0:13109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787115074.182678:0:13109:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787115074.182684:0:13109:0:(genops.c:906:class_export_put()) final put ffff8af07b585000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787115074.182688:0:13109:0:(genops.c:865:class_export_destroy()) destroying export ffff8af07b585000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787115074.182713:0:13109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787115074.182913:0:13109:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8af07b584000 00000020:01000000:0.0:1787115074.182938:0:13109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787115074.182943:0:13109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787115074.182947:0:13109:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787115074.182951:0:13109:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8af06eea99c0) has no exports 00000020:00000080:0.0:1787115074.182971:0:13109:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787115074.182977:0:13109:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787115074.182980:0:13109:0:(genops.c:906:class_export_put()) final put ffff8af051280800/OSS_uuid 00000020:00000080:0.0:1787115074.182982:0:13109:0:(genops.c:865:class_export_destroy()) destroying export ffff8af051280800/OSS_uuid for OSS 00000020:01000000:0.0:1787115074.182985:0:13109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1787115074.183077:0:11900:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8af04d601e00:11900] 4 exiting: rc = 0 00000100:00080000:2.0:1787115074.184073:0:5781:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787115074.184245:0:11535:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8af061c29e00:11535] 3 exiting: rc = 0 00000100:00100000:0.0:1787115074.187318:0:6578:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8af047e96c00:6578] 2 exiting: rc = 0 00000100:00100000:3.0:1787115074.189287:0:6577:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8af0450a0200:6577] 1 exiting: rc = 0 00000100:00100000:0.0:1787115074.190194:0:6576:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8af07b210200:6576] 0 exiting: rc = 1 00000100:00100000:2.0:1787115074.195656:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195756:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195762:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195769:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195774:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195780:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195784:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195789:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195794:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195800:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195805:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195811:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195816:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195822:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195827:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195847:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195853:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195859:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195865:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195870:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195874:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195879:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195885:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195889:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195895:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195901:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195906:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195912:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195917:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195923:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195929:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195934:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195940:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195945:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195950:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195954:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195960:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195965:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195971:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195978:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195984:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195989:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195994:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.195999:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.196005:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.196010:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.196015:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.196021:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.196027:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.196032:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.196045:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.196051:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.196067:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.196074:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.196079:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.196085:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.196090:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.196096:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.196101:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.196143:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.196151:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.196156:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.196162:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.196167:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.198456:0:6581:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8af059016400:6581] 1 exiting: rc = 0 00000100:00100000:3.0:1787115074.198706:0:6579:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8af07b211800:6579] 0 exiting: rc = 1 00000100:00100000:2.0:1787115074.198773:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198782:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198787:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198791:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198797:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198802:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198807:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198813:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198818:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198823:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198829:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198834:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198839:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198845:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198850:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198854:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198859:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198865:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198870:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198876:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198881:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198900:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198905:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198911:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198915:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198921:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198926:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198931:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198936:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198941:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198946:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198951:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.198955:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199368:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199377:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199384:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199390:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199395:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199401:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199407:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199412:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199417:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199422:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199427:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199432:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199437:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199442:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199448:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199453:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199459:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199464:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199469:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199474:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199480:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199485:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199492:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199506:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199511:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199516:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199521:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199526:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199531:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199536:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.199542:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.200577:0:6584:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8af059016800:6584] 2 exiting: rc = 0 00000100:00100000:3.0:1787115074.200903:0:6583:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8af059017400:6583] 1 exiting: rc = 0 00000100:00100000:1.0:1787115074.201178:0:6582:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8af07b211000:6582] 0 exiting: rc = 1 00000100:00100000:2.0:1787115074.202081:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202090:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202095:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202101:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202138:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202146:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202162:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202170:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202175:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202181:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202187:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202192:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202198:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202203:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202209:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202215:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202220:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202226:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202232:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202240:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202248:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202256:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202263:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202273:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202280:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202289:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202308:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202313:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202319:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202325:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202331:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202364:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202371:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202377:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202382:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202387:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202393:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202398:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202404:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202410:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202415:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202421:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202428:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202434:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202439:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202445:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202450:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202456:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202463:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202468:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202474:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202478:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202483:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202488:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202493:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202514:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202520:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202527:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202532:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202537:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202543:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202555:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202561:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.202574:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.207190:0:6586:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8af05900da00:6586] 1 exiting: rc = 0 00000100:00100000:3.0:1787115074.207681:0:6585:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8af042de6a00:6585] 0 exiting: rc = 1 00000100:00100000:2.0:1787115074.207844:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207852:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207857:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207863:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207868:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207873:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207879:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207884:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207889:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207894:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207901:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207906:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207912:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207918:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207925:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207932:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207938:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207943:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207948:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207953:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207958:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207963:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207968:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207973:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207979:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207983:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207988:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207994:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.207999:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208005:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208010:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208016:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208033:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208038:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208043:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208049:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208054:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208060:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208066:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208071:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208076:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208081:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208087:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208093:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208098:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208103:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208164:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208171:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208176:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208181:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208186:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208191:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208197:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208202:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208208:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208213:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208219:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208224:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208230:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208235:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208240:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208245:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208250:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.208255:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787115074.212841:0:6587:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8af06ee74400:6587] 0 exiting: rc = 1 00000100:00100000:0.0:1787115074.213281:0:6588:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8af06ee75600:6588] 1 exiting: rc = 0 00000100:00100000:2.0:1787115074.213338:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.213358:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.213366:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.213389:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.213394:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.213410:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.213419:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.213424:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.213430:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.213435:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.213441:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.213446:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.213451:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.213457:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.213463:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.213469:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.213475:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.213495:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.214979:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215006:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215013:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215020:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215026:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215032:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215038:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215046:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215053:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215060:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215066:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215097:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215178:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215188:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215194:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215200:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215206:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215212:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215218:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215224:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215243:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215249:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215255:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215276:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215283:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215290:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215296:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215302:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215308:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215313:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215320:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215333:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215339:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215344:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215363:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215385:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215394:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215400:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215406:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215412:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215419:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215424:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215430:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215439:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215445:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787115074.215450:0:13109:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787115074.236988:0:13109:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787115091.557694:0:13725:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg210-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787115099.556938:0:14139:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787115099.556944:0:14139:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787115099.557061:0:14139:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8af07b587800 00000020:01000004:0.0:1787115099.557079:0:14139:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787115099.557087:0:14139:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787115099.557101:0:14139:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8af042cc8000) 00000020:00000080:0.0:1787115099.557163:0:14139:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787115099.571922:0:14139:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787115099.573992:0:14139:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1787115099.574511:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:1.0:1787115099.574608:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:1.0:1787115099.574696:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:1.0:1787115099.574872:0:14139:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787115099.574937:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:1.0:1787115099.575030:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:1.0:1787115099.575268:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:1.0:1787115099.575579:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:1.0:1787115099.576705:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 592: rc = 0 00100000:10000000:1.0:1787115099.576801:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 592: rc = 0 00100000:10000000:0.0:1787115099.577575:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 648: rc = 0 00100000:10000000:0.0:1787115099.577918:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 648: rc = 0 00100000:10000000:0.0:1787115099.578766:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 648: rc = 0 00100000:10000000:0.0:1787115099.579017:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 648: rc = 0 00100000:10000000:0.0:1787115099.579460:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 648: rc = 0 00100000:10000000:0.0:1787115099.580444:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 648: rc = 0 00100000:10000000:0.0:1787115099.580699:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 648: rc = 0 00100000:10000000:0.0:1787115099.580949:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 648: rc = 0 00100000:10000000:0.0:1787115099.581498:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 648: rc = 0 00100000:10000000:0.0:1787115099.581761:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 648: rc = 0 00100000:10000000:0.0:1787115099.582007:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 648: rc = 0 00100000:10000000:0.0:1787115099.582943:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 648: rc = 0 00100000:10000000:1.0:1787115099.583672:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 666: rc = 0 00100000:10000000:1.0:1787115099.583937:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 666: rc = 0 00100000:10000000:1.0:1787115099.584417:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 666: rc = 0 00100000:10000000:1.0:1787115099.584686:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 666: rc = 0 00100000:10000000:1.0:1787115099.584929:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 666: rc = 0 00100000:10000000:1.0:1787115099.585367:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 666: rc = 0 00100000:10000000:1.0:1787115099.585600:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 666: rc = 0 00100000:10000000:1.0:1787115099.585847:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 666: rc = 0 00100000:10000000:1.0:1787115099.586088:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 666: rc = 0 00100000:10000000:1.0:1787115099.587738:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 666: rc = 0 00100000:10000000:1.0:1787115099.587969:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 666: rc = 0 00100000:10000000:1.0:1787115099.588417:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 666: rc = 0 00100000:10000000:1.0:1787115099.588716:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 666: rc = 0 00100000:10000000:1.0:1787115099.588939:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 666: rc = 0 00100000:10000000:1.0:1787115099.589397:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 666: rc = 0 00100000:10000000:1.0:1787115099.589751:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 666: rc = 0 00100000:10000000:1.0:1787115099.589989:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 666: rc = 0 00100000:10000000:1.0:1787115099.590416:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 666: rc = 0 00100000:10000000:1.0:1787115099.590724:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 666: rc = 0 00100000:10000000:1.0:1787115099.591061:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 666: rc = 0 00100000:10000000:1.0:1787115099.591365:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 666: rc = 0 00100000:10000000:1.0:1787115099.591640:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 666: rc = 0 00100000:10000000:1.0:1787115099.591880:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 666: rc = 0 00100000:10000000:1.0:1787115099.592379:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 666: rc = 0 00100000:10000000:1.0:1787115099.592622:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 666: rc = 0 00100000:10000000:1.0:1787115099.592829:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 666: rc = 0 00100000:10000000:1.0:1787115099.593035:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 666: rc = 0 00100000:10000000:1.0:1787115099.593602:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 666: rc = 0 00100000:10000000:1.0:1787115099.593834:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 666: rc = 0 00100000:10000000:1.0:1787115099.594069:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 666: rc = 0 00100000:10000000:1.0:1787115099.594696:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 666: rc = 0 00100000:10000000:1.0:1787115099.594949:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 666: rc = 0 00100000:10000000:1.0:1787115099.595808:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 662: rc = 0 00100000:10000000:1.0:1787115099.597016:0:14139:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787115099.597647:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 593: rc = 0 00100000:10000000:2.0:1787115099.597830:0:14139:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787115099.597888:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 593: rc = 0 00100000:10000000:2.0:1787115099.598051:0:14139:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787115099.598101:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 593: rc = 0 00100000:10000000:2.0:1787115099.598716:0:14139:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787115099.598770:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 646: rc = 0 00100000:10000000:2.0:1787115099.598948:0:14139:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1787115099.598997:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 646: rc = 0 00100000:10000000:2.0:1787115099.599425:0:14139:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787115099.599479:0:14139:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 646: rc = 0 00000020:00000080:2.0:1787115099.599802:0:14139:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787115099.599809:0:14139:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787115099.599820:0:14139:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x194cd781e88c930a 00000020:01000004:2.0:1787115099.599828:0:14139:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787115099.599832:0:14139:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787115099.599836:0:14139:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8af07b587800 from MGS 00000020:01000004:2.0:1787115099.599840:0:14139:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787115099.599849:0:14139:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8af06eea99c0) 00000020:00000080:2.0:1787115099.599858:0:14139:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787115099.599905:0:14139:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af07b587800 from MGS, refs=2 00080000:01000000:2.0:1787115099.599908:0:14139:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787115099.599912:0:14139:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x194cd781e88c9318 00000100:00100000:2.0:1787115099.599994:0:14139:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787115099.600096:0:14139:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787115099.600101:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787115099.600963:0:14139:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787115099.600972:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787115099.601873:0:14139:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787115099.602020:0:14139:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787115099.602025:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787115099.607474:0:14139:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787115099.607491:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787115099.607979:0:14139:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787115099.607987:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787115099.609025:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115099.609030:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115099.609032:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115099.609631:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115099.609634:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115099.609636:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115099.610068:0:14139:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787115099.613636:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787115099.627984:0:14139:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787115099.628006:0:14139:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787115099.628008:0:14139:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787115099.636021:0:14149:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787115099.640990:0:14139:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787115099.641137:0:14139:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787115099.642697:0:14139:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787115099.642975:0:14139:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787115099.645679:0:14139:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787115099.645695:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787115099.649471:0:14139:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787115099.649488:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787115099.652163:0:14139:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787115099.652178:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1787115099.655986:0:14154:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1787115099.656097:0:14139:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787115099.656152:0:14139:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.110@tcp' 00000020:01000004:3.0:1787115099.656154:0:14139:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787115099.656190:0:14139:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.110@tcp (typ=mgc) 00000020:00000080:3.0:1787115099.656202:0:14139:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.110@tcp (ffff8af051304d40) 00000020:00000080:3.0:1787115099.656220:0:14139:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787115099.656307:0:14139:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8af046f20800@MGC192.168.202.110@tcp: add connection 192.168.202.110@tcp at head 00010000:00010000:3.0:1787115099.656458:0:14139:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.110@tcp-0 is initialized 00000040:01000000:3.0:1787115099.656465:0:14139:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.110@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787115099.664058:0:14155:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787115099.664712:0:14139:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.110@tcp (uuid 137037ef-42b3-4c5c-b74a-b929b53d47b0) 00000020:00000080:3.0:1787115099.664736:0:14139:0:(genops.c:1406:class_connect()) connect: client 137037ef-42b3-4c5c-b74a-b929b53d47b0, cookie 0x194cd781e88c9326 00000100:00080000:3.0:1787115099.664749:0:14139:0:(import.c:510:import_select_connection()) MGC192.168.202.110@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787115099.664755:0:14139:0:(import.c:624:import_select_connection()) MGC192.168.202.110@tcp: import ffff8af046f20800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:3.0:1787115099.664790:0:14139:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af0513a9c00 x1873925624649600/t0(0) o250->MGC192.168.202.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787115099.664821:0:14139:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 137037ef-42b3-4c5c-b74a-b929b53d47b0->MGS 00000020:01000004:3.0:1787115099.664850:0:14139:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787115099.664873:0:14139:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787115099.664886:0:14139:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8af051300000) 00000020:00000080:3.0:1787115099.664897:0:14139:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787115099.673680:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:137037ef-42b3-4c5c-b74a-b929b53d47b0:3305:1873925624649600:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787115099.673759:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115099.674617:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624649600 00000100:00100000:0.0:1787115099.674628:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624649600 00000100:00100000:0.0:1787115099.674665:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787115099.674673:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3305:x1873925624649600:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787115099.674697:0:14152:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 137037ef-42b3-4c5c-b74a-b929b53d47b0@0@lo t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:0.0:1787115099.674726:0:14152:0:(genops.c:1406:class_connect()) connect: client 137037ef-42b3-4c5c-b74a-b929b53d47b0, cookie 0x194cd781e88c9334 00000100:00080000:0.0:1787115099.675650:0:14152:0:(import.c:65:import_set_state_nolock()) ffff8af07fb03000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787115099.675733:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+5:3305:x1873925624649600:12345-0@lo:250:mount.lustre.0 Request processed in 1058us (1972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115099.675741:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787115099.675791:0:3305:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.110@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787115099.675799:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.110@tcp: connect to target with instance 0 00000100:00080000:0.0:1787115099.675806:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.110@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787115099.675810:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787115099.675813:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af046f20800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787115099.675822:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787115099.676617:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787115099.676627:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:137037ef-42b3-4c5c-b74a-b929b53d47b0:3305:1873925624649600:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787115099.682572:0:14139:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787115099.682730:0:14139:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787115099.682738:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787115099.687758:0:14139:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787115099.687773:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787115099.688369:0:14139:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787115099.688377:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787115099.689834:0:14139:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787115099.690010:0:14139:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787115099.690028:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787115099.690809:0:14139:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787115099.690817:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787115099.731364:0:14139:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787115099.731561:0:14139:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787115099.731568:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787115099.733401:0:14139:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787115099.733417:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787115099.734928:0:14139:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787115099.735095:0:14139:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787115099.735101:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787115099.735899:0:14139:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787115099.735906:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787115099.736731:0:14139:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787115099.736869:0:14139:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787115099.736874:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787115099.737561:0:14139:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787115099.737569:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787115099.738757:0:14139:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787115099.738907:0:14139:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787115099.738912:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787115099.739630:0:14139:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787115099.739638:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787115099.764683:0:14139:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787115099.765436:0:14139:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787115099.765447:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787115099.769951:0:14139:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787115099.769974:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787115099.771247:0:14139:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787115099.771258:0:14139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787115099.776777:0:14139:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787115099.776800:0:14139:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787115099.776806:0:14139:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.110@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787115099.776960:0:14139:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.110@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787115099.776992:0:14139:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.110@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787115099.776996:0:14139:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787115099.776997:0:14139:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787115099.776999:0:14139:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787115099.777000:0:14139:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787115099.777004:0:14139:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787115099.777005:0:14139:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787115099.777007:0:14139:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787115099.777008:0:14139:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787115099.777010:0:14139:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787115099.777010:0:14139:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787115099.777013:0:14139:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787115099.777015:0:14139:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787115099.777016:0:14139:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787115099.777017:0:14139:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787115099.777018:0:14139:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787115099.777019:0:14139:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787115099.777020:0:14139:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787115099.777021:0:14139:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787115099.777022:0:14139:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787115099.777023:0:14139:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787115099.777024:0:14139:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787115099.777053:0:14139:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787115099.777075:0:14139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624649728:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787115099.777210:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115099.777379:0:14139:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af05129e000 going to sleep for 11 seconds 00000100:00100000:0.0:1787115099.777874:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624649728 00000100:00100000:0.0:1787115099.777892:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624649728 00000100:00100000:0.0:1787115099.777946:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787115099.777955:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+5:14139:x1873925624649728:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787115099.778004:0:14153:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787115099.778007:0:14153:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787115099.778009:0:14153:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787115099.778767:0:14173:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787115099.779101:0:14153:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1787115099.780827:0:14174:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787115099.780835:0:14174:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787115099.780838:0:14174:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787115099.780870:0:14174:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1787115099.783489:0:14153:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787115099.783501:0:14153:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787115099.792080:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+5:14139:x1873925624649728:12345-0@lo:253:mount.lustre.0 Request processed in 14114us (14858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115099.792097:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787115099.792442:0:14139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624649728:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787115099.792458:0:14139:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787115099.792462:0:14139:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787115099.792463:0:14139:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787115099.792464:0:14139:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787115099.792466:0:14139:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787115099.792467:0:14139:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787115099.792469:0:14139:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787115099.792470:0:14139:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787115099.792471:0:14139:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787115099.792473:0:14139:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787115099.792475:0:14139:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787115099.792497:0:14139:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8af07b587800 from lustre-MDT0000 10000000:01000000:3.0:1787115099.792731:0:14139:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787115099.792735:0:14139:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787115099.792739:0:14139:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8af051304d40 10000000:01000000:3.0:1787115099.792756:0:14139:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787115099.792764:0:14139:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8af051304d40 from 1 10000000:01000000:3.0:1787115099.792766:0:14139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787115099.792804:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c933b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115099.792815:0:14139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c933b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115099.792824:0:14139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c933b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115099.792843:0:14139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624649856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787115099.792883:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115099.792967:0:14139:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af05129ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787115099.793015:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624649856 00000100:00100000:0.0:1787115099.793022:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624649856 00000100:00100000:0.0:1787115099.793098:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787115099.793134:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+5:14139:x1873925624649856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787115099.793156:0:14151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115099.793170:0:14151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af052364c00/0x194cd781e88c9342 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c933b expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115099.793192:0:14151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af052364c00/0x194cd781e88c9342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c933b expref: 6 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115099.793202:0:14151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af052364c00/0x194cd781e88c9342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c933b expref: 6 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115099.793211:0:14151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052364c00, rc 0) 00000100:00100000:0.0:1787115099.793258:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+6:14139:x1873925624649856:12345-0@lo:101:mount.lustre.0 Request processed in 152us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115099.793264:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787115099.793335:0:14139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624649856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787115099.793348:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c933b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9342 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115099.793357:0:14139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c933b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c9342 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115099.793402:0:14139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624649984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787115099.793425:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115099.793815:0:14139:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af05129ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787115099.793952:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624649984 00000100:00100000:2.0:1787115099.793958:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624649984 00000100:00100000:2.0:1787115099.793981:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787115099.793988:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+6:14139:x1873925624649984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787115099.796731:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+6:14139:x1873925624649984:12345-0@lo:501:mount.lustre.0 Request processed in 2735us (3297us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787115099.796755:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787115099.796997:0:14139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624649984:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787115099.797038:0:14139:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787115099.797059:0:14139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c933b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9342 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115099.797070:0:14139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c933b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9342 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787115099.797080:0:14139:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8af07b587800 10000000:01000000:1.0:1787115099.797085:0:14139:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787115099.797090:0:14139:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8af07b587800 10000000:01000000:1.0:1787115099.797092:0:14139:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787115099.797096:0:14139:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8af07b587800 from 1 10000000:01000000:1.0:1787115099.797098:0:14139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787115099.797169:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1e00/0x194cd781e88c9349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115099.797177:0:14139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1e00/0x194cd781e88c9349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115099.797187:0:14139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1e00/0x194cd781e88c9349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115099.797206:0:14139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624650112:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787115099.797250:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115099.797284:0:14139:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787115099.797455:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624650112 00000100:00100000:0.0:1787115099.797461:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624650112 00000100:00100000:0.0:1787115099.797505:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787115099.797522:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+6:14139:x1873925624650112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787115099.797536:0:14151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115099.797550:0:14151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af052365600/0x194cd781e88c9350 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c9349 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115099.797572:0:14151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af052365600/0x194cd781e88c9350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c9349 expref: 7 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115099.797583:0:14151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af052365600/0x194cd781e88c9350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c9349 expref: 7 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115099.797592:0:14151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052365600, rc 0) 00000100:00100000:0.0:1787115099.797625:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+7:14139:x1873925624650112:12345-0@lo:101:mount.lustre.0 Request processed in 104us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115099.797631:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787115099.797814:0:14139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624650112:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787115099.797826:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1e00/0x194cd781e88c9349 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9350 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115099.797843:0:14139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1e00/0x194cd781e88c9349 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c9350 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787115099.797857:0:14139:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787115099.797861:0:14139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1e00/0x194cd781e88c9349 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9350 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115099.797868:0:14139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1e00/0x194cd781e88c9349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9350 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787115099.797875:0:14139:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787115099.797879:0:14139:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787115099.797884:0:14139:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8af07b587800 10000000:01000000:1.0:1787115099.797886:0:14139:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787115099.797889:0:14139:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787115099.797891:0:14139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787115099.797906:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0c00/0x194cd781e88c9357 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115099.797913:0:14139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0c00/0x194cd781e88c9357 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115099.797920:0:14139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0c00/0x194cd781e88c9357 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115099.797933:0:14139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624650240:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787115099.797957:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115099.797985:0:14139:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787115099.798046:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624650240 00000100:00100000:0.0:1787115099.798050:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624650240 00000100:00100000:0.0:1787115099.798078:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787115099.798084:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+7:14139:x1873925624650240:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787115099.798091:0:14152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115099.798099:0:14152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af052364000/0x194cd781e88c935e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c9357 expref: -99 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115099.798153:0:14152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af052364000/0x194cd781e88c935e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c9357 expref: 8 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115099.798161:0:14152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af052364000/0x194cd781e88c935e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c9357 expref: 8 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115099.798175:0:14152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052364000, rc 0) 00000100:00100000:0.0:1787115099.798201:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+8:14139:x1873925624650240:12345-0@lo:101:mount.lustre.0 Request processed in 117us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115099.798207:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787115099.798723:0:14139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624650240:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787115099.798737:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0c00/0x194cd781e88c9357 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c935e expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115099.798746:0:14139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0c00/0x194cd781e88c9357 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c935e expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115099.798799:0:14139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624650368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787115099.798828:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115099.798855:0:14139:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787115099.798973:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624650368 00000100:00100000:0.0:1787115099.798978:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624650368 00000100:00100000:0.0:1787115099.799011:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787115099.799018:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+8:14139:x1873925624650368:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787115099.799542:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+9:14139:x1873925624650368:12345-0@lo:501:mount.lustre.0 Request processed in 523us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115099.799551:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787115099.799646:0:14139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624650368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787115099.799692:0:14139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624650496:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787115099.799730:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115099.799760:0:14139:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787115099.799839:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624650496 00000100:00100000:2.0:1787115099.799843:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624650496 00000100:00100000:2.0:1787115099.799868:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787115099.799874:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043102050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+9:14139:x1873925624650496:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787115099.800404:0:14139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624650496:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787115099.800586:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043102050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+9:14139:x1873925624650496:12345-0@lo:503:mount.lustre.0 Request processed in 266us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115099.800597:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787115099.800871:0:14175:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f635500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137037ef-42b3-4c5c-b74a-b929b53d47b0:14175:1873925624650624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787115099.800912:0:14175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115099.800971:0:14175:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051e4b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787115099.801002:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624650624 00000100:00100000:1.0:1787115099.801006:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624650624 00000100:00100000:1.0:1787115099.801030:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787115099.801034:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+9:14175:x1873925624650624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787115099.801743:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+9:14175:x1873925624650624:12345-0@lo:502:llog_process_th.0 Request processed in 705us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115099.801756:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787115099.801775:0:14175:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f635500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137037ef-42b3-4c5c-b74a-b929b53d47b0:14175:1873925624650624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787115099.801799:0:14175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787115099.801811:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787115099.801812:0:14175:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787115099.801818:0:14175:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787115099.801820:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787115099.801833:0:14175:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8af042cccd40) 00000020:00000080:0.0:1787115099.801856:0:14175:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787115099.801861:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787115099.801917:0:14175:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787115099.801923:0:14175:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x194cd781e88c936c 00000020:00000080:0.0:1787115099.802098:0:14175:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787115099.802325:0:14175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787115099.802329:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787115099.802330:0:14175:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787115099.802333:0:14175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787115099.802337:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787115099.802339:0:14175:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787115099.802342:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787115099.802350:0:14175:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8af042cc99c0) 00000020:00000080:0.0:1787115099.802361:0:14175:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787115099.802365:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787115099.802367:0:14175:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787115099.802370:0:14175:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787115099.802376:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787115099.802430:0:14175:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af07b587800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787115099.802443:0:14175:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8af042ccb380) 00000020:00000080:0.0:1787115099.802450:0:14175:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787115099.802489:0:14175:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787115099.802492:0:14175:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x194cd781e88c9381 00000020:00000080:0.0:1787115099.802591:0:14175:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787115099.802597:0:14175:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787115099.802602:0:14175:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x194cd781e88c9388 00080000:01000000:0.0:1787115099.802607:0:14175:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787115099.802611:0:14175:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x194cd781e88c938f 00010000:00010000:3.0:1787115099.889995:0:14175:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787115099.890811:0:14175:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1787115099.890986:0:14175:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787115099.891711:0:14175:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8af051303380) 00000020:00000080:3.0:1787115099.891736:0:14175:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787115099.891800:0:14175:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787115099.891807:0:14175:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x194cd781e88c939d 00000020:00000080:1.0:1787115099.892435:0:14175:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787115099.899997:0:14175:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x194cd781e88c93a4 00000020:00000080:2.0:1787115099.900678:0:14175:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787115099.900690:0:14175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787115099.900697:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787115099.900699:0:14175:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787115099.900702:0:14175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787115099.900705:0:14175:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1787115099.900706:0:14175:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787115099.900707:0:14175:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787115099.900709:0:14175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787115099.900711:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787115099.900712:0:14175:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787115099.900715:0:14175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787115099.900720:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787115099.900721:0:14175:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787115099.900725:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787115099.900760:0:14175:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787115099.900776:0:14175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787115099.900780:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787115099.900781:0:14175:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787115099.900784:0:14175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787115099.900788:0:14175:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787115099.900797:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787115099.900799:0:14175:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787115099.900802:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787115099.900808:0:14175:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.110@tcp to nid 0x20000c0a8ca6e (192.168.202.110@tcp) 00000020:01000000:2.0:1787115099.900836:0:14175:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787115099.900839:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787115099.900853:0:14175:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8af06eea8000) 00000020:00000080:2.0:1787115099.900869:0:14175:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787115099.900875:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787115099.900927:0:14175:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787115099.900932:0:14175:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787115099.900938:0:14175:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x194cd781e88c93b2 00010000:00080000:2.0:1787115099.900967:0:14175:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8af059517000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.110@tcp at head 00010000:00010000:2.0:1787115099.901332:0:14175:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1787115099.901730:0:14175:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787115099.901777:0:14175:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787115099.903093:0:14175:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787115099.905376:0:14175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787115099.905467:0:14175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787115099.912417:0:14179:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787115099.912426:0:14179:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787115099.913946:0:14175:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787115099.913961:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787115099.913995:0:14175:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787115099.914017:0:14175:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x194cd781e88c93b9 00000100:00080000:2.0:1787115099.914029:0:14175:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787115099.914035:0:14175:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8af059517000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:2.0:1787115099.914073:0:14175:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af07f6c0e00 x1873925624650752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787115099.914104:0:14175:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787115099.914292:0:14175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787115099.914297:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787115099.914307:0:14175:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787115099.914311:0:14175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787115099.914314:0:14175:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1787115099.914315:0:14175:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787115099.914317:0:14175:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787115099.914318:0:14175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787115099.914321:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787115099.914323:0:14175:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787115099.914325:0:14175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787115099.914329:0:14175:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787115099.914333:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787115099.914334:0:14175:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787115099.914337:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787115099.914341:0:14175:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.110@tcp to nid 0x20000c0a8ca6e (192.168.202.110@tcp) 00000020:01000000:2.0:1787115099.914366:0:14175:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787115099.914369:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787115099.914381:0:14175:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8af06eeacd40) 00000020:00000080:2.0:1787115099.914393:0:14175:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787115099.914398:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787115099.914449:0:14175:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787115099.914455:0:14175:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787115099.914460:0:14175:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x194cd781e88c93c7 00010000:00080000:2.0:1787115099.914505:0:14175:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8af05032f000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.110@tcp at head 00000100:00100000:0.0:1787115099.914701:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624650752:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787115099.914761:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873925624650752 offset 0 length 520: 4 00010000:00010000:2.0:1787115099.915050:0:14175:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787115099.915438:0:14175:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787115099.915462:0:14175:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787115099.916007:0:14175:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787115099.916077:0:14175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787115099.916440:0:14175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787115099.916992:0:14181:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787115099.916998:0:14181:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787115099.917835:0:14175:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787115099.917846:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787115099.917876:0:14175:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787115099.917895:0:14175:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x194cd781e88c93ce 00000100:00080000:2.0:1787115099.918607:0:14175:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787115099.918615:0:14175:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8af05032f000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:2.0:1787115099.918652:0:14175:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af07f6c2300 x1873925624650880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787115099.918783:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624650880:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787115099.918843:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873925624650880 offset 0 length 520: 4 00000100:00080000:2.0:1787115099.918914:0:14175:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787115099.918995:0:14175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787115099.919000:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787115099.919002:0:14175:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787115099.919006:0:14175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787115099.919010:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787115099.919012:0:14175:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787115099.919016:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787115099.919018:0:14175:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787115099.919020:0:14175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787115099.919022:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787115099.919024:0:14175:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787115099.919026:0:14175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787115099.919028:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787115099.919029:0:14175:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787115099.919033:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787115099.919065:0:14175:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137037ef-42b3-4c5c-b74a-b929b53d47b0:14175:1873925624651008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787115099.919157:0:14175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115099.919183:0:14175:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045651900 going to sleep for 11 seconds 00000100:00100000:0.0:1787115099.919432:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624651008 00000100:00100000:0.0:1787115099.919441:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624651008 00000100:00100000:0.0:1787115099.919527:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787115099.919536:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+9:14175:x1873925624651008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787115099.919777:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+9:14175:x1873925624651008:12345-0@lo:502:llog_process_th.0 Request processed in 242us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115099.919786:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787115099.919862:0:14175:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137037ef-42b3-4c5c-b74a-b929b53d47b0:14175:1873925624651008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787115099.919888:0:14175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787115099.919896:0:14175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787115099.919898:0:14175:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787115099.919902:0:14175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787115099.920192:0:14139:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1787115099.920214:0:14139:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787115099.920232:0:14139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0c00/0x194cd781e88c9357 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c935e expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115099.920242:0:14139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0c00/0x194cd781e88c9357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c935e expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787115099.920258:0:14139:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8af07b587800 from 1 10000000:01000000:1.0:1787115099.920260:0:14139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787115099.920289:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0a00/0x194cd781e88c93d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115099.920296:0:14139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0a00/0x194cd781e88c93d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115099.920305:0:14139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0a00/0x194cd781e88c93d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115099.920320:0:14139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624651136:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787115099.920353:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115099.921076:0:14139:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309d600 going to sleep for 11 seconds 00000100:00100000:2.0:1787115099.921148:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624651136 00000100:00100000:2.0:1787115099.921155:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624651136 00000100:00100000:2.0:1787115099.921188:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787115099.921196:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043102c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+9:14139:x1873925624651136:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787115099.921208:0:14152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115099.921226:0:14152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af042cb3000/0x194cd781e88c93dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c93d5 expref: -99 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115099.921264:0:14152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af042cb3000/0x194cd781e88c93dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c93d5 expref: 10 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115099.921275:0:14152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af042cb3000/0x194cd781e88c93dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c93d5 expref: 10 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115099.921285:0:14152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3000, rc 0) 00000100:00100000:2.0:1787115099.921329:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043102c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+10:14139:x1873925624651136:12345-0@lo:101:mount.lustre.0 Request processed in 133us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115099.921336:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787115099.921490:0:14139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624651136:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787115099.921504:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0a00/0x194cd781e88c93d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c93dc expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115099.921524:0:14139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0a00/0x194cd781e88c93d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c93dc expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115099.922047:0:14139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624651264:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787115099.922095:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115099.922230:0:14139:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309d600 going to sleep for 11 seconds 00000100:00100000:2.0:1787115099.922294:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624651264 00000100:00100000:2.0:1787115099.922299:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624651264 00000100:00100000:2.0:1787115099.922325:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787115099.922331:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043101850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+10:14139:x1873925624651264:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787115099.922347:0:14152:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787115099.922352:0:14152:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787115099.922426:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043101850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+10:14139:x1873925624651264:12345-0@lo:256:mount.lustre.0 Request processed in 95us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115099.922432:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787115099.922599:0:14139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624651264:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787115099.923484:0:14139:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787115099.923835:0:14139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0a00/0x194cd781e88c93d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c93dc expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115099.923848:0:14139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0a00/0x194cd781e88c93d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c93dc expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787115099.923856:0:14139:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af07b587800 from 1 10000000:01000000:1.0:1787115099.923859:0:14139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787115099.923896:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0e00/0x194cd781e88c93e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115099.923904:0:14139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0e00/0x194cd781e88c93e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115099.923914:0:14139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0e00/0x194cd781e88c93e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115099.923936:0:14139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624651392:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787115099.923993:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115099.924036:0:14139:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309d600 going to sleep for 11 seconds 00000100:00100000:3.0:1787115099.924085:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624651392 00000100:00100000:3.0:1787115099.924092:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624651392 00000100:00100000:3.0:1787115099.924630:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787115099.924640:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+10:14139:x1873925624651392:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787115099.924654:0:14152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115099.924672:0:14152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af041683000/0x194cd781e88c93ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c93e3 expref: -99 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115099.924692:0:14152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af041683000/0x194cd781e88c93ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c93e3 expref: 11 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115099.924701:0:14152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af041683000/0x194cd781e88c93ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c93e3 expref: 11 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115099.924709:0:14152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041683000, rc 0) 00000100:00100000:3.0:1787115099.924759:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+11:14139:x1873925624651392:12345-0@lo:101:mount.lustre.0 Request processed in 120us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115099.924765:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787115099.924916:0:14139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624651392:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787115099.924931:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0e00/0x194cd781e88c93e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c93ea expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115099.924940:0:14139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0e00/0x194cd781e88c93e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c93ea expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115099.924997:0:14139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624651520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787115099.925023:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115099.925055:0:14139:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309d600 going to sleep for 11 seconds 00000100:00100000:3.0:1787115099.925484:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624651520 00000100:00100000:3.0:1787115099.925491:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624651520 00000100:00100000:3.0:1787115099.925689:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787115099.925698:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+11:14139:x1873925624651520:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787115099.926084:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+11:14139:x1873925624651520:12345-0@lo:501:mount.lustre.0 Request processed in 388us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115099.926092:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787115099.926334:0:14139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624651520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787115099.926376:0:14139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624651648:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787115099.926417:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115099.926448:0:14139:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787115099.926498:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624651648 00000100:00100000:0.0:1787115099.926503:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624651648 00000100:00100000:0.0:1787115099.926531:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787115099.926538:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+11:14139:x1873925624651648:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787115099.926678:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+11:14139:x1873925624651648:12345-0@lo:503:mount.lustre.0 Request processed in 140us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115099.926684:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787115099.926758:0:14139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624651648:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787115099.927364:0:14183:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137037ef-42b3-4c5c-b74a-b929b53d47b0:14183:1873925624651776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787115099.927400:0:14183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115099.927428:0:14183:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309d240 going to sleep for 11 seconds 00000100:00100000:0.0:1787115099.927474:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624651776 00000100:00100000:0.0:1787115099.927478:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624651776 00000100:00100000:0.0:1787115099.927501:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787115099.927516:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+11:14183:x1873925624651776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787115099.927690:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+11:14183:x1873925624651776:12345-0@lo:502:llog_process_th.0 Request processed in 183us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115099.927698:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787115099.927775:0:14183:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137037ef-42b3-4c5c-b74a-b929b53d47b0:14183:1873925624651776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787115099.927796:0:14183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787115099.927805:0:14183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787115099.927807:0:14183:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787115099.927815:0:14183:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8af07b587800 00000020:00000080:1.0:1787115099.927818:0:14183:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787115099.927825:0:14183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787115099.927827:0:14183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787115099.927829:0:14183:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787115099.927831:0:14183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787115099.927834:0:14183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787115099.927835:0:14183:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787115099.927839:0:14183:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8af07b587800 00000020:00000080:1.0:1787115099.927841:0:14183:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787115099.927902:0:14183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787115099.927906:0:14183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787115099.927907:0:14183:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787115099.927910:0:14183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787115099.927912:0:14183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787115099.927913:0:14183:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787115099.927923:0:14183:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8af07b587800 00000020:00000080:1.0:1787115099.927925:0:14183:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787115099.927960:0:14183:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137037ef-42b3-4c5c-b74a-b929b53d47b0:14183:1873925624651904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787115099.927991:0:14183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115099.928012:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624651904 00000100:00100000:1.0:1787115099.928016:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624651904 00000100:00100000:1.0:1787115099.928031:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787115099.928036:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+11:14183:x1873925624651904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787115099.928253:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+11:14183:x1873925624651904:12345-0@lo:502:llog_process_th.0 Request processed in 216us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115099.928260:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787115099.928288:0:14183:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309d240 going to sleep for 11 seconds 00000100:00100000:1.0:1787115099.928298:0:14183:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137037ef-42b3-4c5c-b74a-b929b53d47b0:14183:1873925624651904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787115099.928316:0:14183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787115099.928319:0:14183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787115099.928321:0:14183:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787115099.928323:0:14183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787115099.930613:0:14139:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787115099.930638:0:14139:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787115099.938775:0:14139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0e00/0x194cd781e88c93e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c93ea expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115099.938795:0:14139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0e00/0x194cd781e88c93e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c93ea expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787115099.938856:0:14139:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787115099.938860:0:14139:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8af07b587800 10000000:01000000:1.0:1787115099.938863:0:14139:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8af07b587800 10000000:01000000:1.0:1787115099.938875:0:14139:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787115099.938881:0:14139:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8af07b587800 from 1 10000000:01000000:1.0:1787115099.938884:0:14139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787115099.938920:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c93f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115099.938928:0:14139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c93f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115099.938940:0:14139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c93f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115099.938966:0:14139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624652032:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787115099.939043:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115099.939090:0:14139:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787115099.939092:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624652032 00000100:00100000:2.0:1787115099.939100:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624652032 00000100:00100000:2.0:1787115099.939171:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787115099.939180:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043103c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+11:14139:x1873925624652032:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787115099.939193:0:14151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115099.939205:0:14151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af042cb2400/0x194cd781e88c93f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c93f1 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115099.939366:0:14151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af042cb2400/0x194cd781e88c93f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c93f1 expref: 12 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115099.939377:0:14151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af042cb2400/0x194cd781e88c93f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c93f1 expref: 12 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115099.939386:0:14151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2400, rc 0) 00000100:00100000:2.0:1787115099.939425:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043103c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14139:x1873925624652032:12345-0@lo:101:mount.lustre.0 Request processed in 246us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115099.939431:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787115099.941316:0:14139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624652032:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787115099.941344:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c93f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c93f8 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115099.941355:0:14139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c93f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c93f8 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115099.941431:0:14139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624652160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787115099.941472:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115099.941512:0:14139:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787115099.941661:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624652160 00000100:00100000:2.0:1787115099.941668:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624652160 00000100:00100000:2.0:1787115099.941708:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787115099.941717:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043100850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14139:x1873925624652160:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787115099.942013:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043100850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14139:x1873925624652160:12345-0@lo:501:mount.lustre.0 Request processed in 296us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115099.942019:0:14139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624652160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787115099.942021:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787115099.942048:0:14139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624652288:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787115099.942085:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115099.942198:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624652288 00000100:00100000:2.0:1787115099.942203:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624652288 00000100:00100000:2.0:1787115099.942235:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787115099.942242:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14139:x1873925624652288:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787115099.942388:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14139:x1873925624652288:12345-0@lo:503:mount.lustre.0 Request processed in 145us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115099.942394:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787115099.947367:0:14139:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787115099.947402:0:14139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624652288:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787115099.948645:0:14187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f635500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137037ef-42b3-4c5c-b74a-b929b53d47b0:14187:1873925624652416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787115099.948715:0:14187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115099.948780:0:14187:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04838ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787115099.948817:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624652416 00000100:00100000:2.0:1787115099.948824:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624652416 00000100:00100000:2.0:1787115099.948919:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787115099.948930:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043102850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14187:x1873925624652416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787115099.949225:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043102850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14187:x1873925624652416:12345-0@lo:502:llog_process_th.0 Request processed in 296us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115099.949233:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787115099.949703:0:14187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f635500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137037ef-42b3-4c5c-b74a-b929b53d47b0:14187:1873925624652416:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787115099.949757:0:14187:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787115099.949783:0:14187:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8af07aa00000) 00000020:00000080:0.0:1787115099.949801:0:14187:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1787115099.952484:0:14187:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af07b587800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787115099.952494:0:14187:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8af07b587800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787115099.952517:0:14187:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af07b587800 4 00010000:00080000:0.0:1787115099.952555:0:14187:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8af077f9d800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.110@tcp at head 00010000:00010000:0.0:1787115099.954049:0:14187:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1787115099.959979:0:14187:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787115099.960030:0:14187:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787115099.960046:0:14187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x194cd781e88c9406 00000100:00080000:0.0:1787115099.960057:0:14187:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787115099.960064:0:14187:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8af077f9d800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:0.0:1787115099.960105:0:14187:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af06f635500 x1873925624652544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787115099.960186:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873925624652544:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787115099.960257:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787115099.966822:0:14187:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787115099.971957:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624652544 00000100:00100000:3.0:1787115099.971976:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624652544 00000100:00100000:3.0:1787115099.972016:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787115099.972025:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1873925624652544:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787115099.972301:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1873925624652544:12345-0@lo:38:llog_process_th.0 Request processed in 274us (12041us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787115099.972309:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787115099.972468:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787115099.972478:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af077f9d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787115099.972483:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787115099.972487:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873925624652544:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787115099.973455:0:14187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f634380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137037ef-42b3-4c5c-b74a-b929b53d47b0:14187:1873925624652672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787115099.973651:0:14187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115099.973688:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624652672 00000100:00100000:0.0:1787115099.973695:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624652672 00000100:00100000:0.0:1787115099.973732:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787115099.973740:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14187:x1873925624652672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787115099.974182:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14187:x1873925624652672:12345-0@lo:502:llog_process_th.0 Request processed in 441us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115099.974191:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787115099.974256:0:14187:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af05470fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787115099.974292:0:14187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f634380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137037ef-42b3-4c5c-b74a-b929b53d47b0:14187:1873925624652672:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787115099.974319:0:14187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787115099.975249:0:14139:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787115099.975338:0:14139:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787115099.975357:0:14139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c93f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c93f8 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115099.975369:0:14139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1600/0x194cd781e88c93f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c93f8 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787115099.975420:0:14139:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787115099.975422:0:14139:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787115099.975423:0:14139:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787115099.975424:0:14139:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787115099.975425:0:14139:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787115099.975427:0:14139:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787115099.975428:0:14139:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787115099.975429:0:14139:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787115099.975431:0:14139:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787115099.975432:0:14139:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787115099.975436:0:14139:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787115099.975439:0:14139:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787115099.975440:0:14139:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787115099.975441:0:14139:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787115099.975442:0:14139:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787115099.975443:0:14139:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787115099.975444:0:14139:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787115099.975445:0:14139:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787115099.975446:0:14139:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787115099.975447:0:14139:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787115099.975448:0:14139:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787115099.975471:0:14139:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787115099.975490:0:14139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f634380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624652800:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787115099.975661:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115099.975690:0:14139:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04309d240 going to sleep for 11 seconds 00000100:00100000:2.0:1787115099.978365:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624652800 00000100:00100000:2.0:1787115099.978381:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624652800 00000100:00100000:2.0:1787115099.978448:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787115099.978460:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14139:x1873925624652800:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787115099.978516:0:14152:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787115099.978533:0:14152:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787115100.085100:0:14152:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787115100.085340:0:14152:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787115100.085767:0:14173:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787115100.085773:0:14173:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787115100.085798:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8af07b6a0600/0x194cd781e88c940d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115100.085815:0:14173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af042cb3000/0x194cd781e88c93dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c93d5 expref: 12 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115100.085824:0:14173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8af07b6a0600/0x194cd781e88c940d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115100.086708:0:14173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af042cb3000/0x194cd781e88c93dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c93d5 expref: 12 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115100.086727:0:14173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af042cb3000/0x194cd781e88c93dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c93d5 expref: 12 pid: 14152 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115100.086742:0:14173:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14173:1873925624652928:0@lo:104: 00000100:00100000:1.0:1787115100.086810:0:14173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115100.087007:0:14173:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0585fee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787115100.091503:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624652928 00000100:00100000:0.0:1787115100.091520:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624652928 00000100:00100000:0.0:1787115100.091580:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787115100.091589:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137037ef-42b3-4c5c-b74a-b929b53d47b0+3:14173:x1873925624652928:12345-0@lo:104: 00010000:00010000:0.0:1787115100.091609:0:14141:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0a00/0x194cd781e88c93d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c93dc expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115100.091713:0:14141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787115100.091719:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137037ef-42b3-4c5c-b74a-b929b53d47b0+3:14173:x1873925624652928:12345-0@lo:104: Request processed in 132us (4909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115100.091726:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787115100.091748:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787115100.091753:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0a00/0x194cd781e88c93d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c93dc expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115100.091761:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0a00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:0.0:1787115100.091765:0:14147:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0a00/0x194cd781e88c93d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c93dc expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115100.091773:0:14147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0a00/0x194cd781e88c93d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c93dc expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787115100.091782:0:14147:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0a00/0x194cd781e88c93d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c93dc expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787115100.091789:0:14147:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787115100.091826:0:14147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0a00/0x194cd781e88c93d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c93dc expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115100.091832:0:14147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787115100.092165:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0a00/0x194cd781e88c93d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c93dc expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115100.092173:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0a00/0x194cd781e88c93d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c93dc expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115100.092193:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115100.092195:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115100.092197:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787115100.092510:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137037ef-42b3-4c5c-b74a-b929b53d47b0:3308:1873925624653056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787115100.092556:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115100.092617:0:14143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624653056 00000100:00100000:1.0:1787115100.092623:0:14143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624653056 00010000:00010000:1.0:1787115100.092646:0:14143:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af042cb3000/0x194cd781e88c93dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c93d5 expref: 13 pid: 14152 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115100.092668:0:14143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787115100.092686:0:14143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137037ef-42b3-4c5c-b74a-b929b53d47b0+13:3308:x1873925624653056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787115100.092698:0:14143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787115100.092703:0:14143:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af042cb3000/0x194cd781e88c93dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c93d5 expref: 13 pid: 14152 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115100.092713:0:14143:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af042cb3000/0x194cd781e88c93dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c93d5 expref: 13 pid: 14152 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115100.092730:0:14143:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8af07b6a0600/0x194cd781e88c940d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115100.092738:0:14143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af07b6a0600/0x194cd781e88c940d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787115100.092752:0:14143:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006978988s 00010000:00010000:1.0:1787115100.092756:0:14143:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af07b6a0600/0x194cd781e88c940d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115100.092762:0:14143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af07b6a0600/0x194cd781e88c940d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115100.092768:0:14143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8af07b6a0600/0x194cd781e88c940d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115100.092774:0:14143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8af07b6a0600/0x194cd781e88c940d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115100.092779:0:14143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0600 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:1.0:1787115100.092783:0:14143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8af07b6a0600/0x194cd781e88c940d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115100.092798:0:14143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8af07b6a0600/0x194cd781e88c940d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115100.092807:0:14143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8af07b6a0600/0x194cd781e88c940d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115100.092816:0:14143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787115100.092858:0:14143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137037ef-42b3-4c5c-b74a-b929b53d47b0+13:3308:x1873925624653056:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115100.092866:0:14143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787115100.092904:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137037ef-42b3-4c5c-b74a-b929b53d47b0:3308:1873925624653056:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787115100.093359:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af042cb3000/0x194cd781e88c93dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c93d5 expref: 12 pid: 14152 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115100.093372:0:14173:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14173:1873925624652928:0@lo:104: 00010000:00010000:0.0:1787115100.093388:0:14173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8af07b6a0600/0x194cd781e88c940d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115100.093396:0:14173:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8af07b6a0600/0x194cd781e88c940d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115100.093403:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8af07b6a0600/0x194cd781e88c940d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115100.093409:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af07b6a0600/0x194cd781e88c940d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115100.117563:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+11:14139:x1873925624652800:12345-0@lo:253:mount.lustre.0 Request processed in 139094us (141890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115100.117579:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787115100.117675:0:14139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f634380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14139:1873925624652800:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787115100.117693:0:14139:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787115100.117697:0:14139:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787115100.117699:0:14139:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787115100.117700:0:14139:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787115100.117702:0:14139:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787115100.117714:0:14139:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787115100.117716:0:14139:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787115100.117718:0:14139:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787115100.117719:0:14139:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787115100.117721:0:14139:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787115100.117722:0:14139:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787115100.117737:0:14139:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787115100.126801:0:14139:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787115100.126975:0:14139:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787115100.127742:0:14139:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787115100.127917:0:14139:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787115100.128461:0:14139:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787115100.128646:0:14139:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787115100.129718:0:14139:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787115100.129883:0:14139:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787115100.130264:0:14139:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787115100.130543:0:14139:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787115100.130900:0:14139:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787115100.131369:0:14139:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1787115100.151903:0:14139:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1787115100.152456:0:14139:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787115100.152608:0:14197:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1787115100.152612:0:14197:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1787115100.152689:0:14198:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1787115100.152763:0:14198:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787115100.160723:0:14198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787115100.160810:0:14198:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787115100.160815:0:14198:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1787115100.162873:0:14139:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787115100.163010:0:14139:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787115100.163733:0:14139:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787115100.163746:0:14139:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787115100.163901:0:14139:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787115100.167573:0:14139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787115100.169463:0:14139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787115100.169537:0:14139:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1787115100.171795:0:14139:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1787115100.184049:0:14139:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787115100.259951:0:14139:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787115100.259986:0:14139:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff96d24193f988 00100000:10000000:3.0:1787115100.259995:0:14139:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787115100.261177:0:14139:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787115100.261196:0:14139:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.110@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787115100.261436:0:14139:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787115100.261460:0:14139:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1787115100.614763:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787115101.007249:0:14191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1787115101.384059:0:14155:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787115101.384066:0:14155:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8af07b587800 from 6 10000000:01000000:2.0:1787115101.384071:0:14155:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787115101.384168:0:14155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af042cb3000/0x194cd781e88c9414 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115101.384180:0:14155:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af042cb3000/0x194cd781e88c9414 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115101.384191:0:14155:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af042cb3000/0x194cd781e88c9414 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115101.384215:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624653184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787115101.384283:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115101.384334:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045bd0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787115101.384562:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624653184 00000100:00100000:3.0:1787115101.384570:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624653184 00000100:00100000:3.0:1787115101.384619:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787115101.384628:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+11:14155:x1873925624653184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787115101.384643:0:14153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115101.384656:0:14153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af041682c00/0x194cd781e88c941b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c9414 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115101.384678:0:14153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af041682c00/0x194cd781e88c941b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c9414 expref: 12 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115101.384690:0:14153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af041682c00/0x194cd781e88c941b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c9414 expref: 12 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115101.384700:0:14153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041682c00, rc 0) 00000100:00100000:3.0:1787115101.384745:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14155:x1873925624653184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115101.384752:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787115101.385189:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624653184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787115101.385206:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af042cb3000/0x194cd781e88c9414 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c941b expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115101.385216:0:14155:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af042cb3000/0x194cd781e88c9414 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c941b expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115101.385273:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624653312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787115101.385310:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115101.385334:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045bd0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787115101.386047:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624653312 00000100:00100000:1.0:1787115101.386054:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624653312 00000100:00100000:1.0:1787115101.386091:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787115101.386126:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14155:x1873925624653312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787115101.386156:0:14151:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787115101.386172:0:14151:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787115101.386176:0:14151:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787115101.386265:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14155:x1873925624653312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 167us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115101.386272:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787115101.386319:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624653312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787115101.386370:0:14155:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787115101.386377:0:14155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af042cb3000/0x194cd781e88c9414 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c941b expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115101.386388:0:14155:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af042cb3000/0x194cd781e88c9414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c941b expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115101.637357:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787115102.022331:0:14191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787115102.664947:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115103.692328:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115104.710522:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787115105.157409:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787115105.157417:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787115105.157420:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787115105.157423:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787115105.157426:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787115105.157429:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787115105.157433:0:36:0:(import.c:65:import_set_state_nolock()) ffff8af077f9d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787115105.157445:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8af077f9d800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:1.0:1787115105.157468:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af07f7e5500 x1873925624653568/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787115105.157606:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137037ef-42b3-4c5c-b74a-b929b53d47b0:3309:1873925624653440:0@lo:400:kworker.0 00000100:00100000:3.0:1787115105.157688:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115105.157803:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624653440 00000100:00100000:1.0:1787115105.157812:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624653440 00000100:00100000:1.0:1787115105.157862:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787115105.157871:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:3309:x1873925624653440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787115105.157930:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:3309:x1873925624653440:12345-0@lo:400:kworker.0 Request processed in 60us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115105.157937:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787115105.157990:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137037ef-42b3-4c5c-b74a-b929b53d47b0:3309:1873925624653440:0@lo:400:kworker.0 00000100:00100000:3.0:1787115105.158059:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873925624653568:0@lo:38:kworker.0 00000100:00100000:3.0:1787115105.158098:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115105.158294:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624653568 00000100:00100000:1.0:1787115105.158299:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624653568 00000100:00100000:1.0:1787115105.158328:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787115105.158333:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1873925624653568:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787115105.158380:0:14159:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:1.0:1787115105.158417:0:14159:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x194cd781e88c9422 00000004:00100000:1.0:1787115105.158434:0:14159:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787115105.158696:0:14159:0:(import.c:65:import_set_state_nolock()) ffff8af059177000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787115105.159021:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873925624653568:12345-0@lo:38:kworker.0 Request processed in 686us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115105.159029:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787115105.162970:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8af07f7e5500 x1873925624653568/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787115115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787115105.163014:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787115105.163024:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787115105.163031:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787115105.163035:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af077f9d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787115105.163043:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873925624653568:0@lo:38:kworker.0 00010000:00010000:0.0:1787115105.741398:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787115105.948883:0:14440:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg210-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787115106.757952:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115107.787575:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115108.808460:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787115109.113545:0:14591:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc96272ef0 20000000:00000080:1.0:1787115109.113560:0:14591:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8af07aa1ac00 uarg=0000000000000000 20000000:01000000:1.0:1787115109.113586:0:14591:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787115109.113591:0:14591:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787115109.113596:0:14591:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787115109.114682:0:14592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1787115109.114753:0:14591:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787115109.118431:0:14591:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787115109.118507:0:14591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c9429 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115109.118522:0:14591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af041683000/0x194cd781e88c93ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c93e3 expref: 11 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115109.118527:0:14591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c9429 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115109.118563:0:14591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af041683000/0x194cd781e88c93ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c93e3 expref: 11 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115109.118575:0:14591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af041683000/0x194cd781e88c93ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c93e3 expref: 11 pid: 14152 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115109.118587:0:14591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14591:1873925624653696:0@lo:104: 00000100:00100000:1.0:1787115109.118642:0:14591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115109.118746:0:14591:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0585fef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787115109.118868:0:14142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624653696 00000100:00100000:3.0:1787115109.118875:0:14142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624653696 00000100:00100000:3.0:1787115109.118916:0:14142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787115109.118925:0:14142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137037ef-42b3-4c5c-b74a-b929b53d47b0+3:14591:x1873925624653696:12345-0@lo:104: 00010000:00010000:3.0:1787115109.118939:0:14142:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0e00/0x194cd781e88c93e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c93ea expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115109.119130:0:14142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787115109.119137:0:14142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137037ef-42b3-4c5c-b74a-b929b53d47b0+3:14591:x1873925624653696:12345-0@lo:104: Request processed in 213us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115109.119144:0:14142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787115109.119156:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787115109.119164:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0e00/0x194cd781e88c93e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c93ea expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115109.119172:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0e00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:0.0:1787115109.119176:0:14147:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0e00/0x194cd781e88c93e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c93ea expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115109.119185:0:14147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0e00/0x194cd781e88c93e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c93ea expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787115109.119192:0:14147:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0e00/0x194cd781e88c93e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c93ea expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787115109.119198:0:14147:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787115109.119246:0:14147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0e00/0x194cd781e88c93e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c93ea expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115109.119254:0:14147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787115109.119282:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0e00/0x194cd781e88c93e3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c93ea expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115109.119289:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0e00/0x194cd781e88c93e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c93ea expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115109.119306:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115109.119308:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115109.119310:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787115109.119331:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787115109.119341:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137037ef-42b3-4c5c-b74a-b929b53d47b0:3307:1873925624653824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787115109.119372:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115109.119444:0:14143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624653824 00000100:00100000:3.0:1787115109.119449:0:14143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624653824 00010000:00010000:3.0:1787115109.119466:0:14143:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af041683000/0x194cd781e88c93ea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c93e3 expref: 12 pid: 14152 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115109.119495:0:14143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787115109.119503:0:14143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f635f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:3307:x1873925624653824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787115109.119515:0:14143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787115109.119520:0:14143:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af041683000/0x194cd781e88c93ea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c93e3 expref: 12 pid: 14152 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115109.119541:0:14143:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af041683000/0x194cd781e88c93ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c93e3 expref: 12 pid: 14152 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115109.119556:0:14143:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c9429 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115109.119562:0:14143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c9429 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115109.119570:0:14143:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c9429 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115109.119575:0:14143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c9429 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115109.119580:0:14143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c9429 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115109.119584:0:14143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c9429 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115109.119587:0:14143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1800 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:3.0:1787115109.119590:0:14143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c9429 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115109.119594:0:14143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c9429 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115109.119599:0:14143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c9429 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115109.119611:0:14143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787115109.119639:0:14143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f635f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:3307:x1873925624653824:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115109.119646:0:14143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787115109.119681:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137037ef-42b3-4c5c-b74a-b929b53d47b0:3307:1873925624653824:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787115109.119798:0:14591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af041683000/0x194cd781e88c93ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c93e3 expref: 11 pid: 14152 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115109.119814:0:14591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14591:1873925624653696:0@lo:104: 00010000:00010000:1.0:1787115109.119825:0:14591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c9429 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115109.119832:0:14591:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c9429 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115109.119836:0:14591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c9429 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115109.119847:0:14591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af07b6a1800/0x194cd781e88c9429 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115109.254156:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787115099/real 1787115099] req@ffff8af07f6c2300 x1873925624650880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787115109 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787115109.254191:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8af07f6c2300 x1873925624650880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787115109 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787115109.254202:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787115099/real 1787115099] req@ffff8af07f6c0e00 x1873925624650752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787115109 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787115109.254213:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8af07f6c0e00 x1873925624650752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787115109 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787115109.254230:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af05032f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787115109.254252:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787115109.254256:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624650880:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787115109.254263:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af059517000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787115109.254268:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787115109.254271:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624650752:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787115109.254460:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787115109.254465:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787115109.254468:0:36:0:(import.c:65:import_set_state_nolock()) ffff8af059517000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787115109.254473:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 428 00000100:00080000:3.0:1787115109.254478:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787115109.254484:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8af059517000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:3.0:1787115109.254518:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af0513a8380 x1873925624653952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787115109.254543:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787115109.254546:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787115109.254548:0:36:0:(import.c:65:import_set_state_nolock()) ffff8af05032f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787115109.254552:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 428 00000100:00080000:3.0:1787115109.254554:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787115109.254557:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8af05032f000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:3.0:1787115109.254569:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af0513a8a80 x1873925624654080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787115109.254680:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624654208:0@lo:400:kworker.0 00000100:00100000:2.0:1787115109.254756:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115109.254937:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624654208 00000100:00100000:3.0:1787115109.254945:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624654208 00000100:00100000:3.0:1787115109.255001:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787115109.255012:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624654208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115109.255092:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873925624654208:12345-0@lo:400:kworker.0 Request processed in 81us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115109.255100:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787115109.255441:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624653952:0@lo:8:kworker.0 00000400:00000100:1.0:1787115109.255474:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873925624653952 offset 0 length 520: 4 00000100:00100000:1.0:1787115109.255494:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624654080:0@lo:8:kworker.0 00000400:00000100:1.0:1787115109.255513:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873925624654080 offset 0 length 520: 4 00010000:00080000:2.0:1787115109.255613:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8af0513a8e00 x1873925624654208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787115125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787115109.255638:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873925624654208:0@lo:400:kworker.0 00010000:00010000:0.0:1787115109.830710:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115110.854679:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787115110.854836:0:14155:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787115110.854858:0:14155:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af07b587800 from 10 10000000:01000000:1.0:1787115110.854863:0:14155:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787115110.854904:0:14155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1200/0x194cd781e88c9430 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115110.854914:0:14155:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1200/0x194cd781e88c9430 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115110.854924:0:14155:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1200/0x194cd781e88c9430 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115110.854949:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624654336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787115110.855051:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115110.855134:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051051c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787115110.856148:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624654336 00000100:00100000:3.0:1787115110.856160:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624654336 00000100:00100000:3.0:1787115110.856217:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787115110.856225:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+11:14155:x1873925624654336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787115110.856241:0:14152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115110.856259:0:14152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af041682400/0x194cd781e88c9437 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c9430 expref: -99 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115110.856285:0:14152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af041682400/0x194cd781e88c9437 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c9430 expref: 12 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115110.856296:0:14152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af041682400/0x194cd781e88c9437 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c9430 expref: 12 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115110.856306:0:14152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041682400, rc 0) 00000100:00100000:3.0:1787115110.856677:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14155:x1873925624654336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 450us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115110.856685:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787115110.857074:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624654336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787115110.857094:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1200/0x194cd781e88c9430 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9437 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115110.857104:0:14155:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1200/0x194cd781e88c9430 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c9437 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115110.857193:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624654464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787115110.857233:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115110.857276:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051051c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787115110.857334:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624654464 00000100:00100000:2.0:1787115110.857339:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624654464 00000100:00100000:2.0:1787115110.857390:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787115110.857398:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14155:x1873925624654464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787115110.858024:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14155:x1873925624654464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 616us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115110.858034:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787115110.858268:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624654464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787115110.858313:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624654592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787115110.858376:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115110.858411:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af043018e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787115110.858469:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624654592 00000100:00100000:1.0:1787115110.858476:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624654592 00000100:00100000:1.0:1787115110.858526:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787115110.858533:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14155:x1873925624654592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787115110.858698:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14155:x1873925624654592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115110.858711:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787115110.859041:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624654592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787115110.860219:0:14652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787115110.860772:0:14155:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787115110.860791:0:14155:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787115110.860802:0:14155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1200/0x194cd781e88c9430 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9437 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115110.860812:0:14155:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1200/0x194cd781e88c9430 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9437 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115111.877985:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787115112.261717:0:14191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787115112.901355:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115113.925246:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787115114.082669:0:14792:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787115114.082674:0:14792:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787115114.082783:0:14792:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8af059005000 00000020:01000004:0.0:1787115114.082800:0:14792:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787115114.082813:0:14792:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787115114.082828:0:14792:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8af07aa04d40) 00000020:00000080:0.0:1787115114.082848:0:14792:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787115114.114787:0:14792:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787115114.115292:0:14792:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787115114.116479:0:14792:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787115114.116715:0:14792:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787115114.117038:0:14792:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787115114.117457:0:14792:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1787115114.117550:0:14792:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1787115114.117695:0:14792:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1787115114.118428:0:14792:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 462: rc = 0 00100000:10000000:2.0:1787115114.118680:0:14792:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 462: rc = 0 00100000:10000000:2.0:1787115114.119234:0:14792:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 462: rc = 0 00100000:10000000:2.0:1787115114.119500:0:14792:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 462: rc = 0 00100000:10000000:2.0:1787115114.119749:0:14792:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 462: rc = 0 00100000:10000000:2.0:1787115114.120001:0:14792:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 462: rc = 0 00000020:00000080:2.0:1787115114.120936:0:14792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787115114.120953:0:14792:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787115114.120963:0:14792:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x194cd781e88c9445 00000020:01000004:2.0:1787115114.120972:0:14792:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787115114.121004:0:14792:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.110@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787115114.121007:0:14792:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787115114.121013:0:14792:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787115114.121017:0:14792:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787115114.121027:0:14792:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8af06eeab380) 00000020:00000080:2.0:1787115114.121037:0:14792:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787115114.125487:0:14792:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787115114.125706:0:14792:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787115114.125713:0:14792:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787115114.130455:0:14792:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787115114.130470:0:14792:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787115114.130937:0:14792:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787115114.130945:0:14792:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787115114.132435:0:14792:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787115114.132617:0:14792:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787115114.132625:0:14792:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787115114.134845:0:14792:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787115114.134856:0:14792:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787115114.154530:0:14792:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787115114.154762:0:14792:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787115114.154769:0:14792:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787115114.157418:0:14792:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787115114.157432:0:14792:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787115114.158471:0:14792:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787115114.158480:0:14792:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787115114.161065:0:14792:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787115114.161823:0:14792:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787115114.161831:0:14792:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787115114.163824:0:14792:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787115114.163839:0:14792:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787115114.216686:0:14792:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787115114.216886:0:14792:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787115114.216893:0:14792:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787115114.221300:0:14792:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787115114.221326:0:14792:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787115114.221950:0:14792:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787115114.221975:0:14792:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787115114.221991:0:14792:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.110@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787115114.238697:0:14792:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.110@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787115114.238735:0:14792:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.110@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787115114.238740:0:14792:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787115114.238742:0:14792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787115114.238743:0:14792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787115114.238744:0:14792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787115114.238746:0:14792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787115114.238747:0:14792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787115114.238748:0:14792:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787115114.238750:0:14792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787115114.238751:0:14792:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787115114.238755:0:14792:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787115114.238758:0:14792:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787115114.238759:0:14792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787115114.238760:0:14792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787115114.238761:0:14792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787115114.238762:0:14792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787115114.238763:0:14792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787115114.238764:0:14792:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787115114.238766:0:14792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787115114.238767:0:14792:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787115114.238793:0:14792:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787115114.238814:0:14792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624654720:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787115114.238892:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115114.239001:0:14792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050faa840 going to sleep for 11 seconds 00000100:00100000:1.0:1787115114.239048:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624654720 00000100:00100000:1.0:1787115114.239310:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624654720 00000100:00100000:1.0:1787115114.239434:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787115114.239444:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14792:x1873925624654720:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787115114.239476:0:14153:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787115114.239479:0:14153:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787115114.239485:0:14153:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787115114.245369:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14792:x1873925624654720:12345-0@lo:253:mount.lustre.0 Request processed in 5917us (6467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115114.245384:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787115114.245491:0:14792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624654720:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787115114.245517:0:14792:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787115114.245521:0:14792:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787115114.245522:0:14792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787115114.245524:0:14792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787115114.245525:0:14792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787115114.245526:0:14792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787115114.245528:0:14792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787115114.245529:0:14792:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787115114.245531:0:14792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787115114.245532:0:14792:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787115114.245568:0:14792:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8af059005000 from lustre-OST0000 10000000:01000000:2.0:1787115114.245597:0:14792:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787115114.245600:0:14792:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787115114.245607:0:14792:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8af051304d40 local copy 00010000:00010000:2.0:1787115114.245616:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c933b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9342 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115114.245933:0:14792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624654848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787115114.245967:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115114.246015:0:14792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050faa000 going to sleep for 11 seconds 00000100:00100000:1.0:1787115114.246608:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624654848 00000100:00100000:1.0:1787115114.246616:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624654848 00000100:00100000:1.0:1787115114.246670:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787115114.246679:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14792:x1873925624654848:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787115114.246865:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14792:x1873925624654848:12345-0@lo:501:mount.lustre.0 Request processed in 186us (896us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787115114.246872:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787115114.247218:0:14792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624654848:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787115114.247237:0:14792:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787115114.247399:0:14792:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787115114.247406:0:14792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c933b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9342 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115114.247416:0:14792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c933b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9342 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787115114.247438:0:14792:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8af059005000 10000000:01000000:2.0:1787115114.247442:0:14792:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787115114.247446:0:14792:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8af051304d40 10000000:01000000:2.0:1787115114.247449:0:14792:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787115114.247452:0:14792:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8af051304d40 from 1 10000000:01000000:2.0:1787115114.247455:0:14792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787115114.247482:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af042cb2800/0x194cd781e88c9453 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115114.247490:0:14792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af042cb2800/0x194cd781e88c9453 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115114.247707:0:14792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af042cb2800/0x194cd781e88c9453 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115114.247726:0:14792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624654976:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787115114.247760:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115114.247794:0:14792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050faa000 going to sleep for 11 seconds 00000100:00100000:1.0:1787115114.248012:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624654976 00000100:00100000:1.0:1787115114.248018:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624654976 00000100:00100000:1.0:1787115114.248062:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787115114.248069:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+12:14792:x1873925624654976:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787115114.248079:0:14153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115114.248100:0:14153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af07b6a1c00/0x194cd781e88c945a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c9453 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.248161:0:14153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af07b6a1c00/0x194cd781e88c945a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c9453 expref: 13 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.248173:0:14153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af07b6a1c00/0x194cd781e88c945a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c9453 expref: 13 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.248183:0:14153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a1c00, rc 0) 00000100:00100000:1.0:1787115114.248221:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+13:14792:x1873925624654976:12345-0@lo:101:mount.lustre.0 Request processed in 152us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115114.248227:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787115114.248341:0:14792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624654976:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787115114.248353:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af042cb2800/0x194cd781e88c9453 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c945a expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115114.248361:0:14792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af042cb2800/0x194cd781e88c9453 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c945a expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787115114.248377:0:14792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787115114.248391:0:14792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af042cb2800/0x194cd781e88c9453 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c945a expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115114.248399:0:14792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af042cb2800/0x194cd781e88c9453 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c945a expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787115114.248406:0:14792:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787115114.248411:0:14792:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787115114.248424:0:14792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787115114.248426:0:14792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787115114.248443:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041682200/0x194cd781e88c9461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115114.248450:0:14792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af041682200/0x194cd781e88c9461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115114.248458:0:14792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af041682200/0x194cd781e88c9461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115114.248470:0:14792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624655104:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787115114.248497:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115114.248535:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624655104 00000100:00100000:3.0:1787115114.248539:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624655104 00000100:00100000:3.0:1787115114.248565:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787115114.248572:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+13:14792:x1873925624655104:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787115114.248579:0:14152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115114.248587:0:14152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af041683000/0x194cd781e88c9468 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c9461 expref: -99 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115114.248602:0:14152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af041683000/0x194cd781e88c9468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c9461 expref: 14 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115114.248610:0:14152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af041683000/0x194cd781e88c9468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c9461 expref: 14 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115114.248616:0:14152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041683000, rc 0) 00000100:00100000:3.0:1787115114.248775:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+14:14792:x1873925624655104:12345-0@lo:101:mount.lustre.0 Request processed in 203us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115114.248792:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787115114.248820:0:14792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051051c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787115114.248832:0:14792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624655104:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787115114.248843:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af041682200/0x194cd781e88c9461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9468 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115114.248850:0:14792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af041682200/0x194cd781e88c9461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c9468 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787115114.249473:0:14792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787115114.251862:0:14792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787115114.252190:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787115114.252234:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787115114.252269:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787115114.252329:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787115114.252366:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787115114.252396:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787115114.252469:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787115114.252477:0:14792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787115114.252946:0:14792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624655232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787115114.253078:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115114.253286:0:14792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0510519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787115114.256022:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624655232 00000100:00100000:0.0:1787115114.256037:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624655232 00000100:00100000:0.0:1787115114.256125:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787115114.256160:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+14:14792:x1873925624655232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787115114.257367:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+14:14792:x1873925624655232:12345-0@lo:501:mount.lustre.0 Request processed in 1208us (4286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115114.257380:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787115114.258264:0:14792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624655232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787115114.258477:0:14792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624655360:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787115114.258765:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115114.258866:0:14792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0510519c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787115114.258941:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624655360 00000100:00100000:1.0:1787115114.258948:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624655360 00000100:00100000:2.0:1787115114.259015:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787115114.259027:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+14:14792:x1873925624655360:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787115114.259902:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+14:14792:x1873925624655360:12345-0@lo:503:mount.lustre.0 Request processed in 872us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115114.259913:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787115114.260567:0:14792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624655360:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787115114.261739:0:14792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787115114.261813:0:14792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624655488:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787115114.261876:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115114.261966:0:14792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0510519c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787115114.262013:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624655488 00000100:00100000:2.0:1787115114.262019:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624655488 00000100:00100000:2.0:1787115114.262289:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787115114.262301:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+14:14792:x1873925624655488:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787115114.262586:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+14:14792:x1873925624655488:12345-0@lo:502:mount.lustre.0 Request processed in 287us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115114.262594:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787115114.262758:0:14792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624655488:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787115114.263034:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787115114.263098:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787115114.263193:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787115114.263256:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787115114.263294:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787115114.263327:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787115114.263375:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787115114.263411:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787115114.263445:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1787115114.263490:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1787115114.263791:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1787115114.263847:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1787115114.263884:0:14792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624655616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787115114.263938:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115114.264953:0:14792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0510519c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787115114.265063:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624655616 00000100:00100000:2.0:1787115114.265073:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624655616 00000100:00100000:2.0:1787115114.265153:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787115114.265162:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af061de7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+14:14792:x1873925624655616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787115114.265366:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af061de7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+14:14792:x1873925624655616:12345-0@lo:502:mount.lustre.0 Request processed in 205us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115114.265374:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787115114.265815:0:14792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624655616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787115114.265913:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787115114.265927:0:14792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1787115114.268974:0:14806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787115114.268999:0:14806:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787115114.269007:0:14806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787115114.269009:0:14806:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787115114.269015:0:14806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787115114.269042:0:14806:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8af0513019c0) 00000020:00000080:3.0:1787115114.269074:0:14806:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787115114.269081:0:14806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787115114.269373:0:14806:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af059005000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787115114.269381:0:14806:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787115114.269393:0:14806:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x194cd781e88c9476 00010000:00010000:3.0:1787115114.281096:0:14806:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1787115114.282090:0:14806:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1787115114.285929:0:14806:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787115114.289377:0:14806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787115114.289400:0:14806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787115114.289407:0:14806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787115114.289409:0:14806:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787115114.289413:0:14806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787115114.289416:0:14806:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1787115114.289417:0:14806:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787115114.289418:0:14806:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787115114.289420:0:14806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787115114.289422:0:14806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787115114.289423:0:14806:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787115114.289426:0:14806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787115114.289429:0:14806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787115114.289430:0:14806:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787115114.289432:0:14806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787115114.289434:0:14806:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787115114.289437:0:14806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787115114.289439:0:14806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787115114.289440:0:14806:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787115114.289442:0:14806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787115114.289444:0:14806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787115114.289445:0:14806:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787115114.289448:0:14806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787115114.289693:0:14806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787115114.289698:0:14806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787115114.289705:0:14806:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787115114.289709:0:14806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1787115114.294716:0:14792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787115114.294754:0:14792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787115114.295384:0:14792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041682200/0x194cd781e88c9461 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9468 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115114.295400:0:14792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af041682200/0x194cd781e88c9461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9468 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787115114.295498:0:14792:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af059005000 from 1 10000000:01000000:2.0:1787115114.295511:0:14792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787115114.295546:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af042cb3a00/0x194cd781e88c947d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115114.295554:0:14792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af042cb3a00/0x194cd781e88c947d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115114.295564:0:14792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af042cb3a00/0x194cd781e88c947d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115114.295586:0:14792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624655744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787115114.295658:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115114.295698:0:14792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050faa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787115114.296001:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624655744 00000100:00100000:0.0:1787115114.296008:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624655744 00000100:00100000:0.0:1787115114.296064:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787115114.296072:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af050301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+14:14792:x1873925624655744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787115114.296084:0:14151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115114.296097:0:14151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af052365200/0x194cd781e88c9484 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c947d expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115114.296153:0:14151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af052365200/0x194cd781e88c9484 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c947d expref: 15 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115114.296165:0:14151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af052365200/0x194cd781e88c9484 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c947d expref: 15 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115114.296174:0:14151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052365200, rc 0) 00000100:00100000:0.0:1787115114.296212:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af050301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+15:14792:x1873925624655744:12345-0@lo:101:mount.lustre.0 Request processed in 140us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115114.296226:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787115114.296489:0:14792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624655744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787115114.296515:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af042cb3a00/0x194cd781e88c947d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9484 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115114.296525:0:14792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af042cb3a00/0x194cd781e88c947d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c9484 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787115114.297323:0:14792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787115114.299298:0:14792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787115114.300341:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787115114.300414:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787115114.300489:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787115114.300497:0:14792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787115114.301300:0:14792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624655872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787115114.301368:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115114.301462:0:14792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050faa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787115114.302701:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624655872 00000100:00100000:0.0:1787115114.302711:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624655872 00000100:00100000:0.0:1787115114.302795:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787115114.302806:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af050303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+15:14792:x1873925624655872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787115114.303103:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af050303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+15:14792:x1873925624655872:12345-0@lo:501:mount.lustre.0 Request processed in 299us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115114.303131:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787115114.303361:0:14792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624655872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787115114.303412:0:14792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624656000:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787115114.303457:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115114.303653:0:14792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af043037c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787115114.303775:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624656000 00000100:00100000:2.0:1787115114.303780:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624656000 00000100:00100000:2.0:1787115114.303805:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787115114.303812:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af050303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+15:14792:x1873925624656000:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787115114.303971:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af050303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+15:14792:x1873925624656000:12345-0@lo:503:mount.lustre.0 Request processed in 158us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115114.303978:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787115114.304441:0:14792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624656000:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787115114.304960:0:14792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787115114.305040:0:14792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624656128:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787115114.305098:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115114.305141:0:14792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af043037c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787115114.305701:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624656128 00000100:00100000:2.0:1787115114.305709:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624656128 00000100:00100000:2.0:1787115114.305733:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787115114.305740:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af050302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+15:14792:x1873925624656128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787115114.305958:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af050302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+15:14792:x1873925624656128:12345-0@lo:502:mount.lustre.0 Request processed in 217us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115114.305966:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787115114.306417:0:14792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624656128:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787115114.306854:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787115114.306906:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787115114.306956:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787115114.307007:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787115114.307043:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787115114.308048:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787115114.308401:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787115114.308447:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787115114.308493:0:14792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624656256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787115114.308752:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115114.308844:0:14792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050faa000 going to sleep for 11 seconds 00000100:00100000:0.0:1787115114.308887:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624656256 00000100:00100000:0.0:1787115114.308894:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624656256 00000100:00100000:0.0:1787115114.308969:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787115114.308979:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+15:14792:x1873925624656256:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787115114.309316:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+15:14792:x1873925624656256:12345-0@lo:502:mount.lustre.0 Request processed in 338us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115114.309325:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787115114.309428:0:14792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624656256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787115114.309817:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787115114.309830:0:14792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787115114.311293:0:14810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787115114.311305:0:14810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787115114.311307:0:14810:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787115114.311314:0:14810:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8af059005000 00000020:00000080:3.0:1787115114.311316:0:14810:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787115114.311323:0:14810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787115114.311326:0:14810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787115114.311335:0:14810:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787115114.311339:0:14810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787115114.311342:0:14810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787115114.311343:0:14810:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787115114.311347:0:14810:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8af059005000 00000020:00000080:3.0:1787115114.311349:0:14810:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787115114.311406:0:14810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787115114.311410:0:14810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787115114.311411:0:14810:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787115114.311414:0:14810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787115114.311416:0:14810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787115114.311417:0:14810:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787115114.311421:0:14810:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8af059005000 00000020:00000080:3.0:1787115114.311423:0:14810:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787115114.311459:0:14810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787115114.311463:0:14810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787115114.311465:0:14810:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787115114.311467:0:14810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787115114.319273:0:14792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787115114.319319:0:14792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787115114.319340:0:14792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af042cb3a00/0x194cd781e88c947d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9484 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115114.319354:0:14792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af042cb3a00/0x194cd781e88c947d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9484 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787115114.319409:0:14792:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787115114.319412:0:14792:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8af059005000 10000000:01000000:2.0:1787115114.319415:0:14792:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8af059005000 10000000:01000000:2.0:1787115114.319419:0:14792:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787115114.319424:0:14792:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8af059005000 from 1 10000000:01000000:2.0:1787115114.319427:0:14792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787115114.319459:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af042cb2a00/0x194cd781e88c948b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115114.319466:0:14792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af042cb2a00/0x194cd781e88c948b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115114.319476:0:14792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af042cb2a00/0x194cd781e88c948b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115114.319498:0:14792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624656384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787115114.320735:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115114.321451:0:14792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045688480 going to sleep for 11 seconds 00000100:00100000:0.0:1787115114.329473:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624656384 00000100:00100000:0.0:1787115114.329490:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624656384 00000100:00100000:0.0:1787115114.329715:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787115114.329727:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+15:14792:x1873925624656384:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787115114.330471:0:14152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115114.330492:0:14152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af052365000/0x194cd781e88c9492 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c948b expref: -99 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115114.330593:0:14152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af052365000/0x194cd781e88c9492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c948b expref: 16 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115114.330606:0:14152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af052365000/0x194cd781e88c9492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c948b expref: 16 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115114.330692:0:14152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052365000, rc 0) 00000100:00100000:0.0:1787115114.330854:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:14792:x1873925624656384:12345-0@lo:101:mount.lustre.0 Request processed in 1129us (10120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115114.330861:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787115114.331014:0:14792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624656384:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787115114.331035:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af042cb2a00/0x194cd781e88c948b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9492 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115114.331044:0:14792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af042cb2a00/0x194cd781e88c948b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c9492 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787115114.332966:0:14792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787115114.335021:0:14792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787115114.335847:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787115114.335917:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787115114.335953:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787115114.336029:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787115114.336069:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787115114.336148:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787115114.336187:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787115114.336220:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787115114.336346:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787115114.336387:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787115114.336437:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787115114.336490:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787115114.336610:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787115114.336921:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787115114.336956:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787115114.336975:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787115114.337021:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787115114.337073:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787115114.337148:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787115114.337187:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787115114.337241:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787115114.337377:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787115114.337398:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787115114.337428:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787115114.337466:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787115114.337498:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787115114.337876:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787115114.337919:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787115114.338015:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787115114.338023:0:14792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787115114.338179:0:14792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624656512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787115114.338259:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115114.338304:0:14792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045688480 going to sleep for 11 seconds 00000100:00100000:0.0:1787115114.338354:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624656512 00000100:00100000:0.0:1787115114.338363:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624656512 00000100:00100000:0.0:1787115114.338413:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787115114.338424:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:14792:x1873925624656512:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787115114.339836:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:14792:x1873925624656512:12345-0@lo:501:mount.lustre.0 Request processed in 1409us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115114.339847:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787115114.339954:0:14792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624656512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787115114.340015:0:14792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624656640:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787115114.340062:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115114.340087:0:14792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045688480 going to sleep for 11 seconds 00000100:00100000:0.0:1787115114.340643:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624656640 00000100:00100000:0.0:1787115114.340650:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624656640 00000100:00100000:0.0:1787115114.340692:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787115114.340699:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:14792:x1873925624656640:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787115114.340872:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:14792:x1873925624656640:12345-0@lo:503:mount.lustre.0 Request processed in 173us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115114.340879:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787115114.342291:0:14792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624656640:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787115114.343686:0:14792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787115114.343961:0:14792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624656768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787115114.344212:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115114.344322:0:14792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045688480 going to sleep for 11 seconds 00000100:00100000:3.0:1787115114.346301:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624656768 00000100:00100000:3.0:1787115114.346316:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624656768 00000100:00100000:3.0:1787115114.346369:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787115114.346380:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:14792:x1873925624656768:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787115114.346716:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:14792:x1873925624656768:12345-0@lo:502:mount.lustre.0 Request processed in 338us (2503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115114.346725:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787115114.347883:0:14792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624656768:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787115114.350441:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787115114.350542:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787115114.350590:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787115114.350654:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787115114.350706:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787115114.350773:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787115114.350824:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787115114.350866:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787115114.350929:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787115114.350977:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787115114.351060:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787115114.351148:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787115114.351193:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787115114.351233:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787115114.351303:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787115114.351349:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787115114.351390:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787115114.351447:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787115114.351499:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787115114.351535:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787115114.351616:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787115114.351673:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787115114.351724:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787115114.351778:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787115114.351824:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787115114.351862:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787115114.351955:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787115114.352027:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787115114.352086:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787115114.352202:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787115114.352269:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787115114.352321:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1787115114.352366:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1787115114.352430:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1787115114.352476:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1787115114.352529:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1787115114.352576:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1787115114.352645:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1787115114.352744:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1787115114.352797:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1787115114.352857:0:14792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624656896:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787115114.352937:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115114.353694:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624656896 00000100:00100000:0.0:1787115114.353703:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624656896 00000100:00100000:0.0:1787115114.353790:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787115114.353801:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:14792:x1873925624656896:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787115114.354063:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:14792:x1873925624656896:12345-0@lo:502:mount.lustre.0 Request processed in 264us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115114.354071:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787115114.359800:0:14792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045688480 going to sleep for 11 seconds 00000100:00100000:2.0:1787115114.359888:0:14792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624656896:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787115114.360069:0:14792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787115114.360084:0:14792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787115114.364757:0:14815:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787115114.364774:0:14815:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8af0483c0000) 00000020:00000080:2.0:1787115114.364796:0:14815:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1787115114.365086:0:14815:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af059005000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787115114.365091:0:14815:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8af059005000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787115114.365094:0:14815:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af059005000 3 00010000:00080000:2.0:1787115114.365224:0:14815:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8af07c6a7000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.110@tcp at head 00010000:00010000:2.0:1787115114.368006:0:14815:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1787115114.368300:0:14815:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787115114.368338:0:14815:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787115114.368352:0:14815:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x194cd781e88c94a0 00000100:00080000:2.0:1787115114.368363:0:14815:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787115114.368368:0:14815:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8af07c6a7000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:2.0:1787115114.368410:0:14815:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af07f6c0000 x1873925624657024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787115114.368438:0:14815:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787115114.368907:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787115114.368922:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787115114.368925:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787115114.368927:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787115114.369234:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1873925624657024:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787115114.369293:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115114.369338:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787115114.369343:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624657152:0@lo:400:kworker.0 00000100:00100000:1.0:1787115114.369360:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115114.369394:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624657024 00000100:00100000:1.0:1787115114.369400:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624657024 00000100:00100000:0.0:1787115114.369400:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624657152 00000100:00100000:0.0:1787115114.369407:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624657152 00000100:00100000:1.0:1787115114.369441:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787115114.369449:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624657152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787115114.369489:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624657152:12345-0@lo:400:kworker.0 Request processed in 42us (128us total) trans 0 rc 0/0 00000040:00080000:2.0:1787115114.370498:0:14815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1787115114.375473:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787115114.375487:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1873925624657024:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787115114.375502:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787115114.375521:0:14159:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00010000:00080000:1.0:1787115114.375593:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8af06f634380 x1873925624657152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787115130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787115114.375623:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624657152:0@lo:400:kworker.0 00000020:00000080:0.0:1787115114.376001:0:14159:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x194cd781e88c94a7 00000004:00100000:0.0:1787115114.376020:0:14159:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787115114.376066:0:14159:0:(import.c:65:import_set_state_nolock()) ffff8af07b2ca800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787115114.376293:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873925624657024:12345-0@lo:38:llog_process_th.0 Request processed in 807us (6996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115114.376300:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:0.0:1787115114.376333:0:14792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787115114.376367:0:14792:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787115114.376385:0:14792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af042cb2a00/0x194cd781e88c948b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9492 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115114.376397:0:14792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af042cb2a00/0x194cd781e88c948b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9492 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1787115114.376399:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8af07f6c0000 x1873925624657024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787115124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787115114.376415:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787115114.376422:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000020:01000004:0.0:1787115114.376451:0:14792:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787115114.376453:0:14792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787115114.376454:0:14792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787115114.376456:0:14792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787115114.376461:0:14792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787115114.376463:0:14792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787115114.376464:0:14792:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787115114.376466:0:14792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787115114.376467:0:14792:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787115114.376470:0:14792:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787115114.376473:0:14792:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787115114.376474:0:14792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787115114.376475:0:14792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787115114.376476:0:14792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787115114.376476:0:14792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787115114.376477:0:14792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787115114.376478:0:14792:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787115114.376479:0:14792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787115114.376480:0:14792:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787115114.376513:0:14792:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787115114.376531:0:14792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f636300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624657280:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787115114.376850:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115114.376888:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624657280 00000100:00100000:0.0:1787115114.376895:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624657280 00000100:00100000:0.0:1787115114.377010:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787115114.377020:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:14792:x1873925624657280:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787115114.377043:0:14153:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00080000:1.0:1787115114.377086:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787115114.377094:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787115114.377307:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af07c6a7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787115114.377316:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1873925624657024:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787115114.378238:0:14792:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af04979ba80 going to sleep for 11 seconds 20000000:01000000:0.0:1787115114.379910:0:14153:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787115114.416308:0:14153:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787115114.416329:0:14153:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787115114.417078:0:14173:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787115114.417087:0:14173:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787115114.417136:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8af042cb2000/0x194cd781e88c94ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115114.417166:0:14173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af041682c00/0x194cd781e88c941b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c9414 expref: 16 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115114.417175:0:14173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8af042cb2000/0x194cd781e88c94ae lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115114.417217:0:14173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af041682c00/0x194cd781e88c941b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c9414 expref: 16 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115114.417232:0:14173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af041682c00/0x194cd781e88c941b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c9414 expref: 16 pid: 14153 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115114.417267:0:14173:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14173:1873925624657408:0@lo:104: 00000100:00100000:2.0:1787115114.417333:0:14173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115114.417375:0:14173:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0456889c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787115114.418287:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624657408 00000100:00100000:0.0:1787115114.418298:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624657408 00000100:00100000:0.0:1787115114.418397:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787115114.418408:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137037ef-42b3-4c5c-b74a-b929b53d47b0+3:14173:x1873925624657408:12345-0@lo:104: 00010000:00010000:0.0:1787115114.418421:0:14141:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af042cb3000/0x194cd781e88c9414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c941b expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115114.418502:0:14141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787115114.418517:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137037ef-42b3-4c5c-b74a-b929b53d47b0+3:14173:x1873925624657408:12345-0@lo:104: Request processed in 111us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115114.418524:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787115114.418658:0:14173:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14173:1873925624657408:0@lo:104: 00010000:00010000:2.0:1787115114.418683:0:14173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8af042cb2000/0x194cd781e88c94ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.423256:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787115114.423271:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af042cb3000/0x194cd781e88c9414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c941b expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.423284:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3000 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:1.0:1787115114.423288:0:14147:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af042cb3000/0x194cd781e88c9414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c941b expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.423299:0:14147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af042cb3000/0x194cd781e88c9414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c941b expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787115114.423306:0:14147:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af042cb3000/0x194cd781e88c9414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c941b expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787115114.423312:0:14147:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787115114.423357:0:14147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af042cb3000/0x194cd781e88c9414 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c941b expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.423378:0:14147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787115114.423403:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af042cb3000/0x194cd781e88c9414 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c941b expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.423410:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af042cb3000/0x194cd781e88c9414 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c941b expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.423427:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115114.423429:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115114.423431:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787115114.423447:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787115114.423467:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137037ef-42b3-4c5c-b74a-b929b53d47b0:3308:1873925624657536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787115114.423805:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115114.423863:0:14145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624657536 00000100:00100000:1.0:1787115114.423871:0:14145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624657536 00010000:00010000:1.0:1787115114.423897:0:14145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af041682c00/0x194cd781e88c941b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c9414 expref: 17 pid: 14153 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115114.424272:0:14145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787115114.424282:0:14145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137037ef-42b3-4c5c-b74a-b929b53d47b0+17:3308:x1873925624657536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787115114.424299:0:14145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787115114.424305:0:14145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af041682c00/0x194cd781e88c941b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c9414 expref: 17 pid: 14153 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.424316:0:14145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af041682c00/0x194cd781e88c941b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c9414 expref: 17 pid: 14153 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.424331:0:14145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af041682c00/0x194cd781e88c941b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c9414 expref: 17 pid: 14153 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.424354:0:14145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8af042cb2000/0x194cd781e88c94ae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.424362:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af042cb2000/0x194cd781e88c94ae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787115114.424378:0:14145:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007292236s 00010000:00010000:1.0:1787115114.424383:0:14145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af042cb2000/0x194cd781e88c94ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.424389:0:14145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af042cb2000/0x194cd781e88c94ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.424396:0:14145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8af042cb2000/0x194cd781e88c94ae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.424402:0:14145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8af042cb2000/0x194cd781e88c94ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.424408:0:14145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2000 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:1.0:1787115114.424412:0:14145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8af042cb2000/0x194cd781e88c94ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.424419:0:14145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8af042cb2000/0x194cd781e88c94ae lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.424434:0:14145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8af042cb2000/0x194cd781e88c94ae lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.424444:0:14145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787115114.424489:0:14145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:3308:x1873925624657536:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115114.424497:0:14145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787115114.424978:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137037ef-42b3-4c5c-b74a-b929b53d47b0:3308:1873925624657536:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787115114.425016:0:14173:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8af042cb2000/0x194cd781e88c94ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.425024:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8af042cb2000/0x194cd781e88c94ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115114.425030:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af042cb2000/0x194cd781e88c94ae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115114.427532:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+15:14792:x1873925624657280:12345-0@lo:253:mount.lustre.0 Request processed in 50506us (50674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115114.427556:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787115114.427700:0:14792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f636300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:14792:1873925624657280:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787115114.427713:0:14792:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787115114.427716:0:14792:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787115114.427718:0:14792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787115114.427719:0:14792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787115114.427720:0:14792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787115114.427722:0:14792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787115114.427723:0:14792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787115114.427725:0:14792:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787115114.427726:0:14792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787115114.427728:0:14792:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787115114.427744:0:14792:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787115114.434437:0:14792:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787115114.434661:0:14792:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787115114.434813:0:14792:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787115114.435139:0:14792:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787115114.435436:0:14792:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787115114.435738:0:14792:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787115114.443519:0:14792:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787115114.502013:0:14792:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787115114.502023:0:14792:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787115114.502840:0:14792:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787115114.502907:0:14792:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.110@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787115114.502922:0:14792:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787115114.502956:0:14792:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787115114.949821:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787115115.973218:0:14155:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787115115.973229:0:14155:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8af07b587800 from 7 10000000:01000000:1.0:1787115115.973234:0:14155:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787115115.973293:0:14155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0800/0x194cd781e88c94b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115115.973322:0:14155:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0800/0x194cd781e88c94b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115115.973334:0:14155:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0800/0x194cd781e88c94b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115115.973362:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624657664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787115115.973433:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115115.973492:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0413773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787115115.973619:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624657664 00000100:00100000:0.0:1787115115.973628:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624657664 00000100:00100000:0.0:1787115115.973685:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787115115.973693:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+15:14155:x1873925624657664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787115115.973707:0:14152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115115.973721:0:14152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af052365c00/0x194cd781e88c94bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c94b5 expref: -99 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115115.973743:0:14152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af052365c00/0x194cd781e88c94bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c94b5 expref: 16 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115115.973754:0:14152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af052365c00/0x194cd781e88c94bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c94b5 expref: 16 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115115.973764:0:14152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052365c00, rc 0) 00000100:00100000:0.0:1787115115.973810:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:14155:x1873925624657664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115115.973817:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787115115.973900:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624657664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787115115.973916:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0800/0x194cd781e88c94b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c94bc expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115115.973924:0:14155:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0800/0x194cd781e88c94b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c94bc expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115115.973987:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624657792:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787115115.974019:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115115.974043:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045b74e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787115115.974092:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624657792 00000100:00100000:0.0:1787115115.974101:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624657792 00000100:00100000:0.0:1787115115.974149:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787115115.974155:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:14155:x1873925624657792:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787115115.974169:0:14153:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787115115.974183:0:14153:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787115115.974185:0:14153:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787115115.974262:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:14155:x1873925624657792:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115115.974268:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787115115.974293:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624657792:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787115115.974344:0:14155:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787115115.974350:0:14155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0800/0x194cd781e88c94b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c94bc expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115115.974359:0:14155:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0800/0x194cd781e88c94b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c94bc expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115115.978935:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115116.998092:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115118.024452:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115119.045300:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787115119.495716:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787115119.495723:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787115119.495726:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787115119.495729:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787115119.495776:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624658176:0@lo:400:kworker.0 00000100:00100000:3.0:1787115119.495849:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115119.495922:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624658176 00000100:00100000:3.0:1787115119.495931:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624658176 00000100:00100000:3.0:1787115119.496015:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787115119.496025:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624658176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115119.496077:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873925624658176:12345-0@lo:400:kworker.0 Request processed in 54us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115119.496085:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787115119.496159:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af0513a9880 x1873925624658176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787115135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787115119.496299:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873925624658176:0@lo:400:kworker.0 00000100:00100000:3.0:1787115119.496344:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137037ef-42b3-4c5c-b74a-b929b53d47b0:3306:1873925624657920:0@lo:400:kworker.0 00000100:00100000:3.0:1787115119.496439:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115119.496462:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787115119.496467:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624658048:0@lo:400:kworker.0 00000100:00100000:3.0:1787115119.496487:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115119.496778:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624657920 00000100:00100000:0.0:1787115119.496784:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624657920 00000100:00100000:0.0:1787115119.496815:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787115119.496822:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:3306:x1873925624657920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787115119.496867:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:3306:x1873925624657920:12345-0@lo:400:kworker.0 Request processed in 45us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115119.496873:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787115119.496901:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624658048 00000100:00100000:0.0:1787115119.496905:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624658048 00000100:00100000:0.0:1787115119.496953:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787115119.496960:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624658048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787115119.497001:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624658048:12345-0@lo:400:kworker.0 Request processed in 41us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115119.497006:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787115119.497035:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af0513ab480 x1873925624658048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787115135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787115119.497045:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624658048:0@lo:400:kworker.0 00000100:00100000:0.0:1787115119.497054:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137037ef-42b3-4c5c-b74a-b929b53d47b0:3306:1873925624657920:0@lo:400:kworker.0 00000100:00080000:0.0:1787115119.498451:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787115120.069322:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115121.094522:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787115121.207714:0:15161:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg210-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787115122.117876:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787115122.503528:0:14191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787115123.143464:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115124.165436:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787115124.614916:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787115109/real 1787115109] req@ffff8af0513a8380 x1873925624653952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787115124 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787115124.614945:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8af0513a8380 x1873925624653952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787115124 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787115124.614956:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787115109/real 1787115109] req@ffff8af0513a8a80 x1873925624654080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787115124 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787115124.614966:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8af0513a8a80 x1873925624654080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787115124 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787115124.614984:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af059517000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787115124.615009:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787115124.615013:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624653952:0@lo:8:kworker.0 00000100:00080000:0.0:1787115124.615019:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af05032f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787115124.615039:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787115124.615042:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624654080:0@lo:8:kworker.0 00000100:00080000:2.0:1787115124.615192:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787115124.615198:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787115124.615201:0:8:0:(import.c:65:import_set_state_nolock()) ffff8af059517000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787115124.615207:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 438 00000100:00080000:2.0:1787115124.615212:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787115124.615219:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8af059517000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:2.0:1787115124.615246:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af07f6c3800 x1873925624658432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787115124.615261:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787115124.615265:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787115124.615266:0:8:0:(import.c:65:import_set_state_nolock()) ffff8af05032f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787115124.615269:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 438 00000100:00080000:2.0:1787115124.615272:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787115124.615277:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8af05032f000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:2.0:1787115124.615289:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af07f6c2d80 x1873925624658560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787115124.615562:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787115124.615574:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137037ef-42b3-4c5c-b74a-b929b53d47b0:3308:1873925624658304:0@lo:400:kworker.0 00000100:00100000:2.0:1787115124.615637:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115124.615698:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624658688:0@lo:400:kworker.0 00000100:00100000:2.0:1787115124.615725:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115124.615747:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787115124.615752:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624658816:0@lo:400:kworker.0 00000100:00100000:2.0:1787115124.615778:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115124.615810:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624658304 00000100:00100000:2.0:1787115124.615816:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624658304 00000100:00100000:2.0:1787115124.615862:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787115124.615870:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:3308:x1873925624658304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115124.615933:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:3308:x1873925624658304:12345-0@lo:400:kworker.0 Request processed in 63us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115124.615940:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787115124.615982:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624658688 00000100:00100000:2.0:1787115124.615986:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624658688 00000100:00100000:2.0:1787115124.616010:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624658816 00000100:00100000:2.0:1787115124.616013:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624658816 00000100:00100000:2.0:1787115124.616038:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787115124.616044:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624658688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115124.616083:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624658688:12345-0@lo:400:kworker.0 Request processed in 39us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115124.616089:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787115124.616101:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787115124.616136:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624658816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115124.616165:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624658816:12345-0@lo:400:kworker.0 Request processed in 58us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115124.616170:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787115124.618544:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787115124.618596:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af07f6c0380 x1873925624658816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787115140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787115124.618613:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624658816:0@lo:400:kworker.0 00010000:00080000:2.0:1787115124.618625:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af07f6c1500 x1873925624658688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787115140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787115124.618633:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624658688:0@lo:400:kworker.0 00000100:00100000:2.0:1787115124.618665:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137037ef-42b3-4c5c-b74a-b929b53d47b0:3308:1873925624658304:0@lo:400:kworker.0 00000100:00100000:2.0:1787115124.618683:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624658432:0@lo:8:kworker.0 00000100:00100000:2.0:1787115124.618757:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115124.618795:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624658560:0@lo:8:kworker.0 00000100:00100000:2.0:1787115124.618827:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115124.618865:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624658432 00000100:00100000:2.0:1787115124.618871:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624658432 00000100:00100000:2.0:1787115124.618909:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624658560 00000100:00100000:2.0:1787115124.618912:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624658560 00000100:00100000:2.0:1787115124.618923:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787115124.618929:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1873925624658432:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787115124.618957:0:14793:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:2.0:1787115124.618982:0:14793:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x194cd781e88c94c3 00002000:00100000:2.0:1787115124.618995:0:14793:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8af07c6a4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113803 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787115124.619000:0:14793:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787115124.619002:0:14793:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787115124.620769:0:14793:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787115124.620808:0:14793:0:(import.c:65:import_set_state_nolock()) ffff8af07c6a4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787115124.620908:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1873925624658432:12345-0@lo:8:kworker.0 Request processed in 1975us (2149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115124.620918:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787115124.620943:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787115124.620949:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1873925624658560:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787115124.620963:0:14793:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787115124.620990:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1873925624658560:12345-0@lo:8:kworker.0 Request processed in 41us (2163us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787115124.620995:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787115124.621325:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af07f6c3800 x1873925624658432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787115144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787115124.621339:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787115124.621349:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787115124.621359:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787115124.621364:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787115124.621367:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af059517000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787115124.621397:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787115124.621403:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624658432:0@lo:8:kworker.0 00000100:00080000:3.0:1787115124.621423:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af05032f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787115124.621427:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787115124.621430:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624658560:0@lo:8:kworker.0 00000004:00080000:2.0:1787115124.621718:0:14180:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787115124.621741:0:14180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14180:1873925624659072:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787115124.621791:0:14180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115124.621835:0:14180:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045bd0480 going to sleep for 11 seconds 00000100:00100000:2.0:1787115124.621850:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787115124.621858:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624658944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787115124.621898:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115124.621941:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624659072 00000100:00100000:2.0:1787115124.621947:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624659072 00000100:00100000:2.0:1787115124.621997:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787115124.622006:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14180:x1873925624659072:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787115124.623610:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624658944 00000100:00100000:1.0:1787115124.623620:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624658944 00000100:00100000:1.0:1787115124.623661:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787115124.623669:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1873925624658944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787115124.623698:0:14797:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787115124.623765:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1873925624658944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (1878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115124.623772:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787115124.624731:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787115124.630991:0:14179:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787115124.631290:0:14179:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 453617181005ns, next at 0ns, rc = 0 00002000:00080000:2.0:1787115124.634039:0:14796:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787115124.634053:0:14796:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787115124.634058:0:14796:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00010000:00080000:3.0:1787115124.637678:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af07f6c0380 x1873925624658944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787115140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787115124.637709:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624658944:0@lo:13:osp-pre-0-0.0 00002000:00010000:2.0:1787115124.650020:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787115124.650033:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fed60a0/0x194cd781e88c94ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.650148:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787115124.650153:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115124.650161:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fed60a0/0x194cd781e88c94ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.650181:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fed60a0/0x194cd781e88c94ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.650194:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fed60a0/0x194cd781e88c94ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.650203:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fed60a0/0x194cd781e88c94ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.650231:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787115124.650343:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787115124.650352:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fed60a0/0x194cd781e88c94ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.650362:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3e00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:3.0:1787115124.650366:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fed60a0/0x194cd781e88c94ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.650377:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fed60a0/0x194cd781e88c94ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.650402:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fed60a0/0x194cd781e88c94ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.650409:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fed60a0/0x194cd781e88c94ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.650425:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115124.650428:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115124.650430:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787115124.651001:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787115124.651009:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034ce2757/0x194cd781e88c94d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.651019:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787115124.651023:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115124.651028:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034ce2757/0x194cd781e88c94d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.651039:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034ce2757/0x194cd781e88c94d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.651179:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034ce2757/0x194cd781e88c94d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.651187:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034ce2757/0x194cd781e88c94d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.651217:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787115124.651227:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115124.651232:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034ce2757/0x194cd781e88c94d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.651241:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3800 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115124.651251:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034ce2757/0x194cd781e88c94d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.651260:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034ce2757/0x194cd781e88c94d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.651274:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034ce2757/0x194cd781e88c94d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.651280:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034ce2757/0x194cd781e88c94d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.651291:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.651293:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.651294:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787115124.651947:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787115124.651955:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c1f6f2c/0x194cd781e88c94d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.651966:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787115124.651970:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115124.651974:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c1f6f2c/0x194cd781e88c94d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.651985:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c1f6f2c/0x194cd781e88c94d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.651993:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c1f6f2c/0x194cd781e88c94d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.652007:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c1f6f2c/0x194cd781e88c94d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.652028:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787115124.652332:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787115124.652339:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c1f6f2c/0x194cd781e88c94d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.652349:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2c00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787115124.652353:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c1f6f2c/0x194cd781e88c94d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.652361:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c1f6f2c/0x194cd781e88c94d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.652379:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c1f6f2c/0x194cd781e88c94d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.652387:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c1f6f2c/0x194cd781e88c94d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.652401:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115124.652403:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115124.652405:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787115124.652831:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787115124.652838:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8e073b/0x194cd781e88c94df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.652849:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787115124.652853:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115124.652858:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e073b/0x194cd781e88c94df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.652869:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f8e073b/0x194cd781e88c94df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.652877:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8e073b/0x194cd781e88c94df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.652885:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f8e073b/0x194cd781e88c94df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.652939:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787115124.652972:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787115124.652979:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f8e073b/0x194cd781e88c94df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.652987:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3600 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:3.0:1787115124.652991:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e073b/0x194cd781e88c94df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.652998:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8e073b/0x194cd781e88c94df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.653010:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f8e073b/0x194cd781e88c94df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.653017:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f8e073b/0x194cd781e88c94df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.653042:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115124.653044:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115124.653046:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787115124.653954:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787115124.653965:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f64f4024/0x194cd781e88c94e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.653983:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787115124.653987:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115124.653992:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f64f4024/0x194cd781e88c94e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.654003:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f64f4024/0x194cd781e88c94e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.654013:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f64f4024/0x194cd781e88c94e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.654020:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f64f4024/0x194cd781e88c94e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.654040:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787115124.654547:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787115124.654553:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f18480a6/0x194cd781e88c94ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.654562:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787115124.654566:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115124.654570:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f18480a6/0x194cd781e88c94ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.654662:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f18480a6/0x194cd781e88c94ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.654682:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f18480a6/0x194cd781e88c94ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.654690:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f18480a6/0x194cd781e88c94ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.654777:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787115124.655164:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787115124.655173:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f64f4024/0x194cd781e88c94e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.655192:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2e00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787115124.655197:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f64f4024/0x194cd781e88c94e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.655207:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f64f4024/0x194cd781e88c94e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.655227:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f64f4024/0x194cd781e88c94e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.655234:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f64f4024/0x194cd781e88c94e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.655253:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787115124.655257:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f18480a6/0x194cd781e88c94ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.655264:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3400 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787115124.655268:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f18480a6/0x194cd781e88c94ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.655275:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f18480a6/0x194cd781e88c94ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.655286:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f18480a6/0x194cd781e88c94ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.655298:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f18480a6/0x194cd781e88c94ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.655313:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115124.655316:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115124.655318:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787115124.655346:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787115124.655352:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c94f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.655360:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787115124.655363:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115124.655367:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c94f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.655376:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c94f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.655384:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c94f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.655392:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c94f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.655423:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787115124.655697:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787115124.655702:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c94f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.655710:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2200 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787115124.655714:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c94f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.655732:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c94f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.655744:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c94f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.655751:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b33acbab/0x194cd781e88c94f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.655766:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115124.655768:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115124.655770:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787115124.656024:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787115124.656030:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaefce0f/0x194cd781e88c94fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.656038:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787115124.656041:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115124.656141:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaefce0f/0x194cd781e88c94fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.656153:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaefce0f/0x194cd781e88c94fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.656161:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaefce0f/0x194cd781e88c94fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.656169:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaefce0f/0x194cd781e88c94fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.656185:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787115124.656194:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115124.656198:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaefce0f/0x194cd781e88c94fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.656205:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3200 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115124.656216:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaefce0f/0x194cd781e88c94fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.656224:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaefce0f/0x194cd781e88c94fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.656237:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaefce0f/0x194cd781e88c94fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.656244:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaefce0f/0x194cd781e88c94fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.656261:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.656263:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.656265:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115124.656696:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787115124.656907:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787115124.656914:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fed60a0/0x194cd781e88c9502 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.656924:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787115124.656927:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115124.656932:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fed60a0/0x194cd781e88c9502 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.656941:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fed60a0/0x194cd781e88c9502 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.656949:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fed60a0/0x194cd781e88c9502 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.656962:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fed60a0/0x194cd781e88c9502 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.656976:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787115124.656984:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115124.656987:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fed60a0/0x194cd781e88c9502 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.656994:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3e00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115124.656997:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fed60a0/0x194cd781e88c9502 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.657005:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fed60a0/0x194cd781e88c9502 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.657016:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fed60a0/0x194cd781e88c9502 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.657022:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fed60a0/0x194cd781e88c9502 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.657036:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.657037:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.657039:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787115124.657810:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787115124.657825:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034ce2757/0x194cd781e88c9509 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.657835:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787115124.657839:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115124.657844:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034ce2757/0x194cd781e88c9509 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.657854:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034ce2757/0x194cd781e88c9509 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.657863:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034ce2757/0x194cd781e88c9509 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.657870:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034ce2757/0x194cd781e88c9509 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.657900:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787115124.658070:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787115124.658078:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034ce2757/0x194cd781e88c9509 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.658086:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3800 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787115124.658090:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034ce2757/0x194cd781e88c9509 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.658239:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034ce2757/0x194cd781e88c9509 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.658255:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034ce2757/0x194cd781e88c9509 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.658262:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034ce2757/0x194cd781e88c9509 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.658276:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115124.658278:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115124.658280:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787115124.658438:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787115124.658444:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009791078e/0x194cd781e88c9510 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.658453:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787115124.658456:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115124.658460:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009791078e/0x194cd781e88c9510 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.658469:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009791078e/0x194cd781e88c9510 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.658485:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009791078e/0x194cd781e88c9510 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.658492:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009791078e/0x194cd781e88c9510 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.658513:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787115124.658553:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787115124.658559:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009791078e/0x194cd781e88c9510 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.658566:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2600 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787115124.658570:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009791078e/0x194cd781e88c9510 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.658660:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009791078e/0x194cd781e88c9510 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.658671:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009791078e/0x194cd781e88c9510 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.658678:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009791078e/0x194cd781e88c9510 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.658692:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115124.658694:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115124.658696:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787115124.659168:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787115124.659174:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000ff68db/0x194cd781e88c9517 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.659183:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787115124.659186:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115124.659191:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000ff68db/0x194cd781e88c9517 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.659201:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000ff68db/0x194cd781e88c9517 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.659209:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000ff68db/0x194cd781e88c9517 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.659216:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000ff68db/0x194cd781e88c9517 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.659240:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787115124.659249:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115124.659253:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000ff68db/0x194cd781e88c9517 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.659260:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2000 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115124.659264:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000ff68db/0x194cd781e88c9517 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.659271:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000ff68db/0x194cd781e88c9517 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.659283:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000ff68db/0x194cd781e88c9517 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.659291:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000ff68db/0x194cd781e88c9517 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.659306:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.659308:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.659310:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787115124.660005:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787115124.660012:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d213606/0x194cd781e88c951e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.660023:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787115124.660032:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115124.660038:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d213606/0x194cd781e88c951e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.660157:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d213606/0x194cd781e88c951e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.660166:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d213606/0x194cd781e88c951e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.660173:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d213606/0x194cd781e88c951e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.660188:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787115124.660199:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115124.660429:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d213606/0x194cd781e88c951e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.660439:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3000 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115124.660443:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d213606/0x194cd781e88c951e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.660451:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d213606/0x194cd781e88c951e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.660465:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d213606/0x194cd781e88c951e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.660484:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d213606/0x194cd781e88c951e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.660502:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.660505:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.660506:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787115124.661264:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787115124.661273:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000591e380/0x194cd781e88c9525 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.661286:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787115124.661290:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115124.661296:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000591e380/0x194cd781e88c9525 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.661308:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000591e380/0x194cd781e88c9525 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.661316:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000591e380/0x194cd781e88c9525 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.661324:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000591e380/0x194cd781e88c9525 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.661339:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787115124.661349:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115124.661359:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000591e380/0x194cd781e88c9525 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.661367:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af08216e000 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115124.661371:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000591e380/0x194cd781e88c9525 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.661379:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000591e380/0x194cd781e88c9525 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.661392:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000591e380/0x194cd781e88c9525 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.661399:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000591e380/0x194cd781e88c9525 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.661416:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.661418:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.661420:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787115124.666568:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787115124.666580:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d16c8c89/0x194cd781e88c952c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.666598:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1787115124.666602:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787115124.666609:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d16c8c89/0x194cd781e88c952c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.666629:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d16c8c89/0x194cd781e88c952c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.666640:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d16c8c89/0x194cd781e88c952c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.666648:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d16c8c89/0x194cd781e88c952c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.666669:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787115124.666690:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787115124.666698:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d16c8c89/0x194cd781e88c952c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.667051:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0200 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:3.0:1787115124.667057:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d16c8c89/0x194cd781e88c952c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.667069:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d16c8c89/0x194cd781e88c952c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.667092:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d16c8c89/0x194cd781e88c952c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.667101:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d16c8c89/0x194cd781e88c952c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.667150:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115124.667153:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115124.667156:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787115124.667259:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787115124.667265:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c9533 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.667275:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1787115124.667279:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787115124.667284:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c9533 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.667296:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c9533 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.667305:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c9533 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.667324:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c9533 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.667342:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787115124.667401:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115124.667409:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c9533 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.667419:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1a00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115124.667423:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c9533 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.667445:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c9533 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.667457:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c9533 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.667464:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012be3d87/0x194cd781e88c9533 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.667483:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.667485:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.667488:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787115124.667815:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787115124.667823:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c953a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.667833:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1787115124.667837:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787115124.667842:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c953a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.667852:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c953a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.667861:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c953a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.667869:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c953a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.667904:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787115124.667915:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787115124.667921:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c953a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.667936:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1000 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:3.0:1787115124.667940:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c953a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.667949:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c953a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.667962:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c953a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.667970:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db7981a9/0x194cd781e88c953a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.667986:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115124.667989:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115124.667992:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787115124.668416:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787115124.668424:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416be2a1/0x194cd781e88c9541 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.668441:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1787115124.668444:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787115124.668449:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416be2a1/0x194cd781e88c9541 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.668461:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416be2a1/0x194cd781e88c9541 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.668470:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416be2a1/0x194cd781e88c9541 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.668477:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416be2a1/0x194cd781e88c9541 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.668499:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787115124.668599:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115124.668606:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416be2a1/0x194cd781e88c9541 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.668615:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0e00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115124.668620:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416be2a1/0x194cd781e88c9541 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.668629:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416be2a1/0x194cd781e88c9541 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.668644:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416be2a1/0x194cd781e88c9541 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.668663:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416be2a1/0x194cd781e88c9541 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.668682:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.668684:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.668686:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787115124.672677:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787115124.672692:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d215abca/0x194cd781e88c9548 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.672710:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1787115124.672714:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787115124.672721:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d215abca/0x194cd781e88c9548 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.672736:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d215abca/0x194cd781e88c9548 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.672759:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d215abca/0x194cd781e88c9548 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.672766:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d215abca/0x194cd781e88c9548 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.672785:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787115124.672800:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787115124.672807:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d215abca/0x194cd781e88c9548 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.672816:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1800 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:1.0:1787115124.672820:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d215abca/0x194cd781e88c9548 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.672830:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d215abca/0x194cd781e88c9548 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.672847:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d215abca/0x194cd781e88c9548 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.672854:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d215abca/0x194cd781e88c9548 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115124.672871:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115124.672879:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115124.672882:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787115124.673067:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1787115124.674939:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787115124.674951:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cabc4488/0x194cd781e88c954f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.674968:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1787115124.674972:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787115124.674978:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cabc4488/0x194cd781e88c954f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.674992:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cabc4488/0x194cd781e88c954f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.675002:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cabc4488/0x194cd781e88c954f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.675014:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cabc4488/0x194cd781e88c954f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.675083:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787115124.675674:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787115124.675681:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed81a2fd/0x194cd781e88c9556 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.675691:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1787115124.675694:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787115124.675699:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed81a2fd/0x194cd781e88c9556 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.675709:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed81a2fd/0x194cd781e88c9556 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.675718:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed81a2fd/0x194cd781e88c9556 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.675724:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed81a2fd/0x194cd781e88c9556 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.677540:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787115124.677555:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cabc4488/0x194cd781e88c954f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.677569:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364a00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115124.677583:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cabc4488/0x194cd781e88c954f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.677595:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cabc4488/0x194cd781e88c954f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.677620:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cabc4488/0x194cd781e88c954f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.677628:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cabc4488/0x194cd781e88c954f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.677648:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115124.677651:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed81a2fd/0x194cd781e88c9556 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.677665:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364200 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115124.677668:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed81a2fd/0x194cd781e88c9556 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.677675:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed81a2fd/0x194cd781e88c9556 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.677685:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed81a2fd/0x194cd781e88c9556 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.677693:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.677695:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.677698:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115124.678294:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787115124.678304:0:14796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed81a2fd/0x194cd781e88c9556 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.683476:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787115124.685166:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115124.685180:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027307541/0x194cd781e88c955d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.685198:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787115124.685204:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115124.685211:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027307541/0x194cd781e88c955d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.685240:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027307541/0x194cd781e88c955d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.685254:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027307541/0x194cd781e88c955d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.685262:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027307541/0x194cd781e88c955d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.685288:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787115124.685303:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787115124.685309:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027307541/0x194cd781e88c955d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.685317:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682e00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:3.0:1787115124.685322:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027307541/0x194cd781e88c955d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.685331:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027307541/0x194cd781e88c955d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.685351:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027307541/0x194cd781e88c955d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.685358:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027307541/0x194cd781e88c955d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.685391:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115124.685394:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115124.685398:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787115124.686570:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115124.686740:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc3f48b5/0x194cd781e88c9564 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.686753:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787115124.686757:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115124.686762:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc3f48b5/0x194cd781e88c9564 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.686775:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc3f48b5/0x194cd781e88c9564 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.686783:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc3f48b5/0x194cd781e88c9564 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.686791:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc3f48b5/0x194cd781e88c9564 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.686851:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787115124.687347:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115124.687354:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f56878/0x194cd781e88c956b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.687374:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787115124.687378:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115124.687382:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094f56878/0x194cd781e88c956b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.687393:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094f56878/0x194cd781e88c956b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.687401:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f56878/0x194cd781e88c956b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.687409:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094f56878/0x194cd781e88c956b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.687677:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787115124.687686:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc3f48b5/0x194cd781e88c9564 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.687696:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041683200 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787115124.687700:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc3f48b5/0x194cd781e88c9564 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.687709:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc3f48b5/0x194cd781e88c9564 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.687727:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc3f48b5/0x194cd781e88c9564 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.687736:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc3f48b5/0x194cd781e88c9564 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.687755:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787115124.687759:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094f56878/0x194cd781e88c956b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.687765:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682800 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787115124.687769:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f56878/0x194cd781e88c956b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.687789:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f56878/0x194cd781e88c956b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.687800:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094f56878/0x194cd781e88c956b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.687807:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115124.687809:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115124.687811:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115124.687921:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787115124.687927:0:14796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094f56878/0x194cd781e88c956b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787115124.688503:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115124.688511:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de21715c/0x194cd781e88c9572 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.688521:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787115124.688525:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115124.688530:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de21715c/0x194cd781e88c9572 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.688553:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de21715c/0x194cd781e88c9572 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.688561:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de21715c/0x194cd781e88c9572 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.688568:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de21715c/0x194cd781e88c9572 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.688823:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115124.688831:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de21715c/0x194cd781e88c9572 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.688839:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041683400 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115124.688843:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de21715c/0x194cd781e88c9572 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.688851:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de21715c/0x194cd781e88c9572 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.688868:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de21715c/0x194cd781e88c9572 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.688884:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.688896:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.688898:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115124.688975:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787115124.688981:0:14796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de21715c/0x194cd781e88c9572 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787115124.689560:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115124.689566:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d30ea05/0x194cd781e88c9579 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.689744:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115124.689775:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787115124.689780:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115124.689786:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d30ea05/0x194cd781e88c9579 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.689798:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d30ea05/0x194cd781e88c9579 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.689817:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d30ea05/0x194cd781e88c9579 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.689825:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d30ea05/0x194cd781e88c9579 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.689871:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787115124.690407:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115124.690414:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0cab5b0/0x194cd781e88c9580 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.690424:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787115124.690427:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115124.690432:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0cab5b0/0x194cd781e88c9580 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.690441:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0cab5b0/0x194cd781e88c9580 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.690450:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0cab5b0/0x194cd781e88c9580 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.690457:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0cab5b0/0x194cd781e88c9580 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.690729:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787115124.690737:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d30ea05/0x194cd781e88c9579 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.690745:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041683800 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115124.690750:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d30ea05/0x194cd781e88c9579 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.690758:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d30ea05/0x194cd781e88c9579 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.690776:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d30ea05/0x194cd781e88c9579 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.690785:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d30ea05/0x194cd781e88c9579 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.690808:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115124.690812:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0cab5b0/0x194cd781e88c9580 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.690819:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682600 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115124.690831:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0cab5b0/0x194cd781e88c9580 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.690839:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0cab5b0/0x194cd781e88c9580 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.690851:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0cab5b0/0x194cd781e88c9580 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.690859:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.690861:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115124.690863:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115124.690941:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787115124.690947:0:14796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0cab5b0/0x194cd781e88c9580 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787115124.691515:0:14796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115124.691522:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d00f9a7/0x194cd781e88c9587 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.691532:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787115124.691535:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115124.691540:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d00f9a7/0x194cd781e88c9587 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.691549:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d00f9a7/0x194cd781e88c9587 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.691557:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d00f9a7/0x194cd781e88c9587 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115124.691564:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d00f9a7/0x194cd781e88c9587 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.691741:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787115124.691749:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d00f9a7/0x194cd781e88c9587 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.691758:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682a00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787115124.691762:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d00f9a7/0x194cd781e88c9587 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.691770:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d00f9a7/0x194cd781e88c9587 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.691784:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d00f9a7/0x194cd781e88c9587 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115124.691794:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115124.691796:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115124.691805:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115124.691869:0:14796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787115124.691874:0:14796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d00f9a7/0x194cd781e88c9587 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115124.693408:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787115124.694801:0:14796:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1787115124.694922:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14180:x1873925624659072:12345-0@lo:5:osp-pre-0-0.0 Request processed in 72913us (73127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115124.694939:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787115124.694999:0:14180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14180:1873925624659072:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787115124.695016:0:14180:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1787115124.695127:0:14180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14180:1873925624659200:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787115124.695170:0:14180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115124.695215:0:14180:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06e9270c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787115124.695231:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624659200 00000100:00100000:3.0:1787115124.695237:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624659200 00000100:00100000:3.0:1787115124.695279:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787115124.695288:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14180:x1873925624659200:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787115124.695332:0:14793:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1787115124.717319:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14180:x1873925624659200:12345-0@lo:5:osp-pre-0-0.0 Request processed in 22026us (22143us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787115124.717332:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787115124.717720:0:14180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14180:1873925624659200:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787115124.717736:0:14180:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1787115125.190292:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115126.213316:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115127.237299:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787115127.936646:0:15462:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787115127.936651:0:15462:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787115127.937596:0:15462:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8af06f4bb000 00000020:01000004:3.0:1787115127.937771:0:15462:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787115127.937787:0:15462:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787115127.937816:0:15462:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8aef41afb380) 00000020:00000080:3.0:1787115127.937836:0:15462:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787115127.971422:0:15462:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787115127.973606:0:15462:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787115127.974689:0:15462:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787115127.974931:0:15462:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787115127.975594:0:15462:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787115127.983123:0:15462:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 413: rc = 0 00100000:10000000:0.0:1787115127.983239:0:15462:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 413: rc = 0 00100000:10000000:0.0:1787115127.983363:0:15462:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 413: rc = 0 00100000:10000000:0.0:1787115127.987511:0:15462:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 641: rc = 0 00100000:10000000:0.0:1787115127.987824:0:15462:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:0.0:1787115127.989505:0:15462:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 641: rc = 0 00100000:10000000:0.0:1787115127.993478:0:15462:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:1.0:1787115127.995517:0:15462:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 641: rc = 0 00100000:10000000:1.0:1787115127.995923:0:15462:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 641: rc = 0 00000020:00000080:1.0:1787115127.997707:0:15462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787115127.997810:0:15462:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787115127.997824:0:15462:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x194cd781e88c9595 00000020:01000004:1.0:1787115127.997834:0:15462:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1787115127.997867:0:15462:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.110@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787115127.997871:0:15462:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787115127.997878:0:15462:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787115127.997901:0:15462:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1787115127.997905:0:15462:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.110@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787115128.018542:0:15462:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.110@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787115128.018578:0:15462:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.110@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1787115128.018583:0:15462:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787115128.018585:0:15462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787115128.018586:0:15462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787115128.018587:0:15462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787115128.018589:0:15462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787115128.018590:0:15462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787115128.018591:0:15462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787115128.018592:0:15462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787115128.018594:0:15462:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787115128.018598:0:15462:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1787115128.018600:0:15462:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787115128.018602:0:15462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787115128.018603:0:15462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787115128.018604:0:15462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787115128.018605:0:15462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787115128.018606:0:15462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787115128.018607:0:15462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787115128.018608:0:15462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787115128.018609:0:15462:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787115128.018649:0:15462:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787115128.018678:0:15462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624659328:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787115128.019951:0:15462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115128.020167:0:15462:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050797840 going to sleep for 11 seconds 00000100:00100000:0.0:1787115128.021621:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624659328 00000100:00100000:0.0:1787115128.021636:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624659328 00000100:00100000:0.0:1787115128.021707:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787115128.021718:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:15462:x1873925624659328:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787115128.021831:0:14152:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787115128.021835:0:14152:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787115128.021839:0:14152:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787115128.047303:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:15462:x1873925624659328:12345-0@lo:253:mount.lustre.0 Request processed in 25577us (27346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115128.047321:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787115128.047448:0:15462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624659328:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787115128.047469:0:15462:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787115128.047473:0:15462:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787115128.047475:0:15462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787115128.047477:0:15462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787115128.047478:0:15462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787115128.047479:0:15462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787115128.047481:0:15462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787115128.047482:0:15462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787115128.047484:0:15462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787115128.047485:0:15462:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787115128.047521:0:15462:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8af06f4bb000 from lustre-OST0001 10000000:01000000:1.0:1787115128.047553:0:15462:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787115128.047556:0:15462:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787115128.047567:0:15462:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8af051304d40 local copy 00010000:00010000:1.0:1787115128.047581:0:15462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c933b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9342 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115128.047888:0:15462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624659456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787115128.047927:0:15462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115128.056409:0:15462:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0451dae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787115128.057400:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624659456 00000100:00100000:2.0:1787115128.057416:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624659456 00000100:00100000:2.0:1787115128.057501:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787115128.057513:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:15462:x1873925624659456:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787115128.057878:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:15462:x1873925624659456:12345-0@lo:501:mount.lustre.0 Request processed in 366us (9949us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787115128.057887:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787115128.059348:0:15462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624659456:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787115128.059378:0:15462:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787115128.059618:0:15462:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787115128.059628:0:15462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c933b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9342 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115128.059639:0:15462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af041682000/0x194cd781e88c933b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9342 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787115128.059678:0:15462:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8af06f4bb000 10000000:01000000:0.0:1787115128.059684:0:15462:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787115128.059691:0:15462:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787115128.059693:0:15462:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787115128.059698:0:15462:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787115128.059701:0:15462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787115128.059734:0:15462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c959c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115128.059743:0:15462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c959c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115128.059753:0:15462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c959c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115128.059771:0:15462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f635180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624659584:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787115128.059820:0:15462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115128.059877:0:15462:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06c1d30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787115128.060038:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624659584 00000100:00100000:2.0:1787115128.060045:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624659584 00000100:00100000:2.0:1787115128.060329:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787115128.060340:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:15462:x1873925624659584:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787115128.060353:0:14152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115128.060368:0:14152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af08216f200/0x194cd781e88c95a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c959c expref: -99 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115128.060391:0:14152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af08216f200/0x194cd781e88c95a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c959c expref: 17 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115128.060402:0:14152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af08216f200/0x194cd781e88c95a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c959c expref: 17 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115128.060410:0:14152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216f200, rc 0) 00000100:00100000:2.0:1787115128.060448:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+17:15462:x1873925624659584:12345-0@lo:101:mount.lustre.0 Request processed in 111us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115128.060455:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787115128.060670:0:15462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f635180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624659584:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787115128.060684:0:15462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c959c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c95a3 expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115128.060692:0:15462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c959c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c95a3 expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787115128.061626:0:15462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787115128.066651:0:15462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787115128.066970:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787115128.067016:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787115128.067051:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787115128.067150:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787115128.067197:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787115128.067232:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787115128.067301:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787115128.067310:0:15462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787115128.067434:0:15462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624659712:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787115128.067505:0:15462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115128.067544:0:15462:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0451da480 going to sleep for 11 seconds 00000100:00100000:2.0:1787115128.069064:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624659712 00000100:00100000:2.0:1787115128.069083:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624659712 00000100:00100000:2.0:1787115128.069187:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787115128.069197:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af047e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+17:15462:x1873925624659712:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787115128.069665:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af047e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+17:15462:x1873925624659712:12345-0@lo:501:mount.lustre.0 Request processed in 468us (2158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115128.069686:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787115128.070445:0:15462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624659712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787115128.070523:0:15462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f635180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624659840:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787115128.070582:0:15462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115128.070615:0:15462:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06c1d3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787115128.070732:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624659840 00000100:00100000:2.0:1787115128.070738:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624659840 00000100:00100000:2.0:1787115128.070781:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787115128.070789:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af047e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+17:15462:x1873925624659840:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787115128.071677:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af047e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+17:15462:x1873925624659840:12345-0@lo:503:mount.lustre.0 Request processed in 883us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115128.071689:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787115128.072977:0:15462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f635180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624659840:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787115128.074620:0:15462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787115128.074725:0:15462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f635180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624659968:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787115128.074805:0:15462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115128.074937:0:15462:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06c1d3780 going to sleep for 11 seconds 00000100:00100000:1.0:1787115128.074990:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624659968 00000100:00100000:1.0:1787115128.074998:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624659968 00000100:00100000:1.0:1787115128.075479:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787115128.075490:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af047e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+17:15462:x1873925624659968:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787115128.075750:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af047e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+17:15462:x1873925624659968:12345-0@lo:502:mount.lustre.0 Request processed in 262us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115128.075758:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787115128.075848:0:15462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f635180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624659968:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787115128.076156:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787115128.076205:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787115128.076238:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787115128.076284:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787115128.076321:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787115128.076356:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787115128.076406:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787115128.076443:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787115128.076515:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787115128.076552:0:15462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f635180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624660096:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787115128.076596:0:15462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115128.086774:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624660096 00000100:00100000:3.0:1787115128.086791:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624660096 00000100:00100000:3.0:1787115128.086871:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787115128.086898:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af047e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+17:15462:x1873925624660096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787115128.088040:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af047e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+17:15462:x1873925624660096:12345-0@lo:502:mount.lustre.0 Request processed in 1138us (11436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115128.088050:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787115128.088736:0:15462:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06c1d3780 going to sleep for 11 seconds 00000100:00100000:3.0:1787115128.088767:0:15462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f635180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624660096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787115128.088909:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787115128.088927:0:15462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1787115128.090038:0:15464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787115128.090051:0:15464:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787115128.090059:0:15464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787115128.090061:0:15464:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787115128.090067:0:15464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787115128.090085:0:15464:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8af07fb24d40) 00000020:00000080:1.0:1787115128.090145:0:15464:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787115128.090153:0:15464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787115128.090240:0:15464:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af06f4bb000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787115128.090248:0:15464:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787115128.090255:0:15464:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x194cd781e88c95b1 00010000:00010000:1.0:1787115128.096944:0:15464:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1787115128.106982:0:15464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1787115128.110159:0:15464:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787115128.112508:0:15464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787115128.112522:0:15464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787115128.112530:0:15464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787115128.112532:0:15464:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787115128.112540:0:15464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787115128.112545:0:15464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787115128.112546:0:15464:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787115128.112559:0:15464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787115128.112562:0:15464:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787115128.112564:0:15464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787115128.112566:0:15464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787115128.112567:0:15464:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787115128.112570:0:15464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787115128.112573:0:15464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787115128.112574:0:15464:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787115128.112577:0:15464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787115128.112640:0:15464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787115128.112644:0:15464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787115128.112646:0:15464:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787115128.112650:0:15464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787115128.117957:0:15462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787115128.118005:0:15462:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787115128.118283:0:15462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c959c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c95a3 expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115128.118297:0:15462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af052365a00/0x194cd781e88c959c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c95a3 expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787115128.118305:0:15462:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af06f4bb000 from 1 10000000:01000000:3.0:1787115128.118307:0:15462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787115128.118351:0:15462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041682a00/0x194cd781e88c95b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115128.118359:0:15462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af041682a00/0x194cd781e88c95b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115128.118370:0:15462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af041682a00/0x194cd781e88c95b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115128.118396:0:15462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624660224:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787115128.118485:0:15462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115128.118592:0:15462:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af043018780 going to sleep for 11 seconds 00000100:00100000:2.0:1787115128.122627:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624660224 00000100:00100000:2.0:1787115128.122642:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624660224 00000100:00100000:2.0:1787115128.122694:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787115128.122703:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af047e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+17:15462:x1873925624660224:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787115128.122720:0:14152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115128.122737:0:14152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af08216e200/0x194cd781e88c95bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c95b8 expref: -99 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115128.122765:0:14152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af08216e200/0x194cd781e88c95bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c95b8 expref: 18 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115128.122776:0:14152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af08216e200/0x194cd781e88c95bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c95b8 expref: 18 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115128.122785:0:14152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216e200, rc 0) 00000100:00100000:2.0:1787115128.122872:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af047e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+18:15462:x1873925624660224:12345-0@lo:101:mount.lustre.0 Request processed in 170us (4386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115128.122879:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787115128.123054:0:15462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624660224:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787115128.123082:0:15462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af041682a00/0x194cd781e88c95b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c95bf expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115128.123092:0:15462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af041682a00/0x194cd781e88c95b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c95bf expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787115128.126771:0:15462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787115128.127424:0:15462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787115128.127675:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787115128.127722:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787115128.127788:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787115128.127798:0:15462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787115128.127896:0:15462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624660352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787115128.127968:0:15462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115128.128508:0:15462:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af043018780 going to sleep for 11 seconds 00000100:00100000:2.0:1787115128.129689:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624660352 00000100:00100000:2.0:1787115128.129716:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624660352 00000100:00100000:2.0:1787115128.129765:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787115128.129775:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af047e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+18:15462:x1873925624660352:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787115128.130140:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af047e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+18:15462:x1873925624660352:12345-0@lo:501:mount.lustre.0 Request processed in 366us (2171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115128.130148:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787115128.130537:0:15462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624660352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787115128.130587:0:15462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624660480:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787115128.130635:0:15462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115128.130686:0:15462:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af043018780 going to sleep for 11 seconds 00000100:00100000:2.0:1787115128.131290:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624660480 00000100:00100000:2.0:1787115128.131297:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624660480 00000100:00100000:2.0:1787115128.131332:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787115128.131338:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af047e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+18:15462:x1873925624660480:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787115128.131568:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af047e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+18:15462:x1873925624660480:12345-0@lo:503:mount.lustre.0 Request processed in 228us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115128.131576:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787115128.132594:0:15462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624660480:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787115128.133868:0:15462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787115128.133955:0:15462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624660608:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787115128.134368:0:15462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115128.134460:0:15462:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06c1d3900 going to sleep for 11 seconds 00000100:00100000:2.0:1787115128.146358:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624660608 00000100:00100000:2.0:1787115128.146376:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624660608 00000100:00100000:3.0:1787115128.147347:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787115128.147361:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af047e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+18:15462:x1873925624660608:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787115128.147673:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af047e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+18:15462:x1873925624660608:12345-0@lo:502:mount.lustre.0 Request processed in 314us (13304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115128.147692:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787115128.147806:0:15462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624660608:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787115128.148179:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787115128.148240:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787115128.148292:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787115128.148332:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787115128.148383:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787115128.148436:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787115128.148476:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787115128.148514:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787115128.148555:0:15462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624660736:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787115128.148606:0:15462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115128.148646:0:15462:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0451da180 going to sleep for 11 seconds 00000100:00100000:3.0:1787115128.149359:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624660736 00000100:00100000:3.0:1787115128.149368:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624660736 00000100:00100000:3.0:1787115128.149418:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787115128.149427:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+18:15462:x1873925624660736:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787115128.149646:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+18:15462:x1873925624660736:12345-0@lo:502:mount.lustre.0 Request processed in 220us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115128.149654:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787115128.149902:0:15462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624660736:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787115128.150049:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787115128.150075:0:15462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787115128.151780:0:15468:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787115128.151793:0:15468:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787115128.151795:0:15468:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787115128.151803:0:15468:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8af06f4bb000 00000020:00000080:1.0:1787115128.151805:0:15468:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787115128.151813:0:15468:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787115128.151815:0:15468:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787115128.151817:0:15468:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787115128.151819:0:15468:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787115128.151821:0:15468:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787115128.151822:0:15468:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787115128.151825:0:15468:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8af06f4bb000 00000020:00000080:1.0:1787115128.151827:0:15468:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787115128.151900:0:15468:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787115128.151904:0:15468:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787115128.151905:0:15468:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787115128.151908:0:15468:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787115128.151911:0:15468:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787115128.151912:0:15468:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787115128.151916:0:15468:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8af06f4bb000 00000020:00000080:1.0:1787115128.151918:0:15468:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787115128.151967:0:15468:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787115128.151970:0:15468:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787115128.151972:0:15468:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787115128.151974:0:15468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787115128.152203:0:15462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787115128.152234:0:15462:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787115128.152257:0:15462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041682a00/0x194cd781e88c95b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c95bf expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115128.152270:0:15462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af041682a00/0x194cd781e88c95b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c95bf expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787115128.152315:0:15462:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787115128.152319:0:15462:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8af06f4bb000 10000000:01000000:3.0:1787115128.152322:0:15462:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8af06f4bb000 10000000:01000000:3.0:1787115128.152326:0:15462:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787115128.152332:0:15462:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8af06f4bb000 from 1 10000000:01000000:3.0:1787115128.152336:0:15462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787115128.152370:0:15462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041682600/0x194cd781e88c95c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115128.152378:0:15462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af041682600/0x194cd781e88c95c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115128.152389:0:15462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af041682600/0x194cd781e88c95c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115128.152421:0:15462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624660864:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787115128.152484:0:15462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115128.152541:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624660864 00000100:00100000:3.0:1787115128.152548:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624660864 00000100:00100000:3.0:1787115128.152591:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787115128.152600:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+18:15462:x1873925624660864:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787115128.152612:0:14153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115128.152625:0:14153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af041683400/0x194cd781e88c95cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c95c6 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115128.152648:0:14153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af041683400/0x194cd781e88c95cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c95c6 expref: 19 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115128.152660:0:14153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af041683400/0x194cd781e88c95cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c95c6 expref: 19 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115128.152669:0:14153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af041683400, rc 0) 00000100:00100000:3.0:1787115128.152707:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:15462:x1873925624660864:12345-0@lo:101:mount.lustre.0 Request processed in 108us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115128.152714:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787115128.152755:0:15462:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0430189c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787115128.152775:0:15462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624660864:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787115128.152788:0:15462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af041682600/0x194cd781e88c95c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c95cd expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115128.152797:0:15462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af041682600/0x194cd781e88c95c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c95cd expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787115128.153597:0:15462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787115128.153913:0:15462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787115128.156805:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787115128.156914:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787115128.156948:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787115128.156996:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787115128.159414:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787115128.159522:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787115128.159560:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787115128.159591:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787115128.159634:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787115128.159669:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787115128.159701:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787115128.159748:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787115128.159785:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787115128.159821:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787115128.159885:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787115128.159939:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787115128.159970:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787115128.169772:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787115128.169916:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787115128.169958:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787115128.170037:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787115128.170077:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787115128.170133:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787115128.170188:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787115128.170227:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787115128.170265:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787115128.170317:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787115128.170352:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787115128.170387:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787115128.170466:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1787115128.170503:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1787115128.170553:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1787115128.170587:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1787115128.170631:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1787115128.170665:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1787115128.170710:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1787115128.170748:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1787115128.170846:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1787115128.170866:0:15462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787115128.170971:0:15462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624660992:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787115128.171040:0:15462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115128.171136:0:15462:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0430189c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787115128.177346:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624660992 00000100:00100000:0.0:1787115128.177361:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624660992 00000100:00100000:0.0:1787115128.177427:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787115128.177437:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:15462:x1873925624660992:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787115128.177789:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:15462:x1873925624660992:12345-0@lo:501:mount.lustre.0 Request processed in 352us (6748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115128.177797:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787115128.177877:0:15462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624660992:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787115128.177937:0:15462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f637b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624661120:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787115128.177985:0:15462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115128.178263:0:15462:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06c1d3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787115128.178459:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624661120 00000100:00100000:1.0:1787115128.178465:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624661120 00000100:00100000:1.0:1787115128.178504:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787115128.178512:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:15462:x1873925624661120:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787115128.178678:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:15462:x1873925624661120:12345-0@lo:503:mount.lustre.0 Request processed in 166us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115128.178686:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787115128.178788:0:15462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f637b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624661120:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787115128.179792:0:15462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787115128.179896:0:15462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f637b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624661248:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787115128.179958:0:15462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115128.182484:0:15462:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06c1d3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787115128.189925:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624661248 00000100:00100000:1.0:1787115128.189940:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624661248 00000100:00100000:1.0:1787115128.189997:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787115128.190008:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:15462:x1873925624661248:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787115128.190345:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:15462:x1873925624661248:12345-0@lo:502:mount.lustre.0 Request processed in 339us (10386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115128.190353:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787115128.190543:0:15462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f637b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624661248:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787115128.190901:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787115128.190958:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787115128.190994:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787115128.191042:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787115128.191082:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787115128.191158:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787115128.191195:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787115128.191229:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787115128.191277:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787115128.191330:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787115128.191366:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787115128.191432:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787115128.191493:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787115128.191533:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787115128.191593:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787115128.191634:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787115128.191672:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787115128.191747:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787115128.191788:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787115128.191822:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787115128.191887:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787115128.191924:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787115128.191956:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787115128.192002:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787115128.192038:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787115128.192073:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787115128.192146:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787115128.192200:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787115128.192236:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787115128.192284:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787115128.192317:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787115128.192347:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787115128.192373:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787115128.192417:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787115128.192448:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787115128.192486:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787115128.192514:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787115128.192540:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787115128.192599:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787115128.192644:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787115128.192696:0:15462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624661376:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787115128.192770:0:15462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115128.192834:0:15462:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045b3fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787115128.197401:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624661376 00000100:00100000:1.0:1787115128.197423:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624661376 00000100:00100000:1.0:1787115128.197493:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787115128.197504:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:15462:x1873925624661376:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787115128.197813:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:15462:x1873925624661376:12345-0@lo:502:mount.lustre.0 Request processed in 310us (5042us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115128.197821:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787115128.199641:0:15462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624661376:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787115128.199968:0:15462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787115128.199985:0:15462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787115128.220383:0:15474:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787115128.220402:0:15474:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8af0483c4d40) 00000020:00000080:2.0:1787115128.220427:0:15474:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1787115128.220640:0:15474:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af06f4bb000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787115128.220645:0:15474:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8af06f4bb000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787115128.220648:0:15474:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af06f4bb000 3 00010000:00080000:2.0:1787115128.220682:0:15474:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8af0591dc800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.110@tcp at head 00010000:00010000:2.0:1787115128.222398:0:15474:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1787115128.222507:0:15474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787115128.222543:0:15474:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787115128.222554:0:15474:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x194cd781e88c95db 00000100:00080000:2.0:1787115128.222566:0:15474:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787115128.222571:0:15474:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8af0591dc800 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:2.0:1787115128.222613:0:15474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af07f6c0e00 x1873925624661504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787115128.222646:0:15474:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787115128.222676:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1873925624661504:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787115128.225956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787115128.226161:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787115128.226166:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787115128.226171:0:36:0:(import.c:65:import_set_state_nolock()) ffff8af05032f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787115128.226178:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 453 00000100:00080000:3.0:1787115128.226184:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787115128.226190:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8af05032f000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:3.0:1787115128.226212:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af0513a8700 x1873925624661760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787115128.226268:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624661632:0@lo:400:kworker.0 00000100:00100000:3.0:1787115128.226306:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115128.226338:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624661504 00000100:00100000:3.0:1787115128.226346:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624661760:0@lo:8:kworker.0 00000100:00100000:2.0:1787115128.226348:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624661504 00000100:00100000:3.0:1787115128.226368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115128.226383:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787115128.226390:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1873925624661504:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787115128.226393:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624661888:0@lo:400:kworker.0 00000100:00100000:3.0:1787115128.226414:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787115128.226415:0:14157:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 457 last 0 00000100:00100000:3.0:1787115128.226435:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787115128.226439:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624662016:0@lo:400:kworker.0 00000020:00000080:2.0:1787115128.226455:0:14157:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x194cd781e88c95e2 00000100:00100000:3.0:1787115128.226457:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00100000:2.0:1787115128.226474:0:14157:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1787115128.226485:0:14795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624661632 00000100:00100000:3.0:1787115128.226488:0:14795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624661632 00000100:00100000:3.0:1787115128.226525:0:14795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624661760 00000100:00100000:3.0:1787115128.226528:0:14795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624661760 00000100:00080000:2.0:1787115128.226533:0:14157:0:(import.c:65:import_set_state_nolock()) ffff8aef428c0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787115128.226538:0:14795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787115128.226544:0:14795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1873925624661632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787115128.227197:0:14796:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787115128.227209:0:14796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787115128.227315:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873925624661504:12345-0@lo:38:llog_process_th.0 Request processed in 923us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115128.227324:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787115128.227402:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624661888 00000100:00100000:2.0:1787115128.227408:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624661888 00000100:00100000:2.0:1787115128.227441:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624662016 00000100:00100000:2.0:1787115128.227445:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624662016 00000100:00100000:2.0:1787115128.227462:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787115128.227469:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624661888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115128.227522:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624661888:12345-0@lo:400:kworker.0 Request processed in 52us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115128.227529:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787115128.227541:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787115128.227547:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624662016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115128.227576:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624662016:12345-0@lo:400:kworker.0 Request processed in 29us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115128.227592:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787115128.228158:0:14795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1873925624661632:12345-0@lo:400:kworker.0 Request processed in 1612us (1848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115128.228172:0:14795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787115128.228190:0:14795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787115128.228195:0:14795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1873925624661760:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787115128.228251:0:14795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1873925624661760:12345-0@lo:8:kworker.0 Request processed in 55us (1882us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787115128.228258:0:14795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787115128.228279:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787115128.228297:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787115128.228337:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624661632:0@lo:400:kworker.0 00000100:00100000:3.0:1787115128.228369:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787115128.228375:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af05032f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787115128.228379:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787115128.228382:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624661760:0@lo:8:kworker.0 00010000:00080000:3.0:1787115128.228397:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af07f6c0e00 x1873925624661504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787115138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787115128.228406:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787115128.228412:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787115128.228420:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787115128.228426:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787115128.228428:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af0591dc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787115128.228435:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1873925624661504:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787115128.228464:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af0513a8380 x1873925624662016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787115144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787115128.228472:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624662016:0@lo:400:kworker.0 00010000:00080000:3.0:1787115128.228491:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8af0513a8a80 x1873925624661888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787115144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787115128.228499:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624661888:0@lo:400:kworker.0 00000040:00080000:2.0:1787115128.230466:0:15474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1787115128.233874:0:15462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787115128.233916:0:15462:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787115128.233940:0:15462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af041682600/0x194cd781e88c95c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c95cd expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115128.233953:0:15462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af041682600/0x194cd781e88c95c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c95cd expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787115128.234010:0:15462:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787115128.234012:0:15462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787115128.234013:0:15462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787115128.234014:0:15462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787115128.234015:0:15462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787115128.234017:0:15462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787115128.234018:0:15462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787115128.234021:0:15462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787115128.234022:0:15462:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787115128.234026:0:15462:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787115128.234028:0:15462:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787115128.234030:0:15462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787115128.234031:0:15462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787115128.234032:0:15462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787115128.234033:0:15462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787115128.234034:0:15462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787115128.234035:0:15462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787115128.234036:0:15462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787115128.234037:0:15462:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787115128.234068:0:15462:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787115128.234091:0:15462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624662144:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787115128.234185:0:15462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115128.234264:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624662144 00000100:00100000:3.0:1787115128.234272:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624662144 00000100:00100000:3.0:1787115128.234316:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787115128.234324:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af046ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:15462:x1873925624662144:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787115128.234349:0:14151:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787115128.234362:0:14151:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787115128.236372:0:15462:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045b3fa80 going to sleep for 11 seconds 00010000:00010000:2.0:1787115128.262719:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1787115128.266389:0:14151:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787115128.266411:0:14151:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787115128.266476:0:14173:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787115128.266500:0:14173:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787115128.266527:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8af07b6a1400/0x194cd781e88c95e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115128.266548:0:14173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af052365c00/0x194cd781e88c94bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c94b5 expref: 19 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115128.266557:0:14173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8af07b6a1400/0x194cd781e88c95e9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115128.266602:0:14173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af052365c00/0x194cd781e88c94bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c94b5 expref: 19 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115128.266620:0:14173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af052365c00/0x194cd781e88c94bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c94b5 expref: 19 pid: 14152 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115128.266640:0:14173:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14173:1873925624662272:0@lo:104: 00000100:00100000:1.0:1787115128.266727:0:14173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115128.266781:0:14173:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af05129ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787115128.267533:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624662272 00000100:00100000:3.0:1787115128.267544:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624662272 00000100:00100000:3.0:1787115128.267593:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787115128.267602:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137037ef-42b3-4c5c-b74a-b929b53d47b0+3:14173:x1873925624662272:12345-0@lo:104: 00010000:00010000:3.0:1787115128.267618:0:14141:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0800/0x194cd781e88c94b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c94bc expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115128.267717:0:14141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787115128.267724:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137037ef-42b3-4c5c-b74a-b929b53d47b0+3:14173:x1873925624662272:12345-0@lo:104: Request processed in 123us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115128.267731:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787115128.267757:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787115128.267763:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0800/0x194cd781e88c94b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c94bc expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115128.267771:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0800 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:3.0:1787115128.267776:0:14146:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0800/0x194cd781e88c94b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c94bc expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115128.267784:0:14146:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0800/0x194cd781e88c94b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c94bc expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787115128.267808:0:14146:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0800/0x194cd781e88c94b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c94bc expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787115128.267814:0:14146:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787115128.267848:0:14146:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0800/0x194cd781e88c94b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c94bc expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115128.267886:0:14146:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787115128.267908:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0800/0x194cd781e88c94b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c94bc expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115128.267914:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af07b6a0800/0x194cd781e88c94b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c94bc expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115128.267934:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115128.267936:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115128.267938:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787115128.267951:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137037ef-42b3-4c5c-b74a-b929b53d47b0:3308:1873925624662400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787115128.267986:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115128.268224:0:14173:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14173:1873925624662272:0@lo:104: 00010000:00010000:0.0:1787115128.268246:0:14173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8af07b6a1400/0x194cd781e88c95e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115128.269619:0:14145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624662400 00000100:00100000:1.0:1787115128.269635:0:14145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624662400 00010000:00010000:1.0:1787115128.269674:0:14145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af052365c00/0x194cd781e88c94bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c94b5 expref: 20 pid: 14152 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115128.269753:0:14145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787115128.269765:0:14145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137037ef-42b3-4c5c-b74a-b929b53d47b0+20:3308:x1873925624662400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787115128.269782:0:14145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787115128.269789:0:14145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af052365c00/0x194cd781e88c94bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c94b5 expref: 20 pid: 14152 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115128.269802:0:14145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af052365c00/0x194cd781e88c94bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c94b5 expref: 20 pid: 14152 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115128.269837:0:14145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af052365c00/0x194cd781e88c94bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c94b5 expref: 20 pid: 14152 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115128.269865:0:14145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8af07b6a1400/0x194cd781e88c95e9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115128.269874:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af07b6a1400/0x194cd781e88c95e9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787115128.269895:0:14145:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007292236s 00010000:00010000:1.0:1787115128.269899:0:14145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af07b6a1400/0x194cd781e88c95e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115128.269906:0:14145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af07b6a1400/0x194cd781e88c95e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115128.269914:0:14145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8af07b6a1400/0x194cd781e88c95e9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115128.269921:0:14145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8af07b6a1400/0x194cd781e88c95e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115128.269928:0:14145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1400 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:1.0:1787115128.269932:0:14145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8af07b6a1400/0x194cd781e88c95e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115128.269941:0:14145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8af07b6a1400/0x194cd781e88c95e9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115128.269958:0:14145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8af07b6a1400/0x194cd781e88c95e9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115128.269974:0:14145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787115128.270062:0:14145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:3308:x1873925624662400:12345-0@lo:103:ldlm_bl.0 Request processed in 297us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115128.270069:0:14145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787115128.270673:0:14173:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8af07b6a1400/0x194cd781e88c95e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115128.270685:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8af07b6a1400/0x194cd781e88c95e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115128.270691:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af07b6a1400/0x194cd781e88c95e9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115128.270743:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137037ef-42b3-4c5c-b74a-b929b53d47b0:3308:1873925624662400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787115128.278665:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af046ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+18:15462:x1873925624662144:12345-0@lo:253:mount.lustre.0 Request processed in 44328us (44466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115128.278684:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787115128.278786:0:15462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137037ef-42b3-4c5c-b74a-b929b53d47b0:15462:1873925624662144:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787115128.278805:0:15462:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787115128.278808:0:15462:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787115128.278810:0:15462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787115128.278811:0:15462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787115128.278812:0:15462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787115128.278813:0:15462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787115128.278814:0:15462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787115128.278816:0:15462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787115128.278818:0:15462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787115128.278819:0:15462:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787115128.278834:0:15462:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787115128.282339:0:15462:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787115128.282485:0:15462:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787115128.282619:0:15462:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787115128.282743:0:15462:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787115128.282879:0:15462:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787115128.283636:0:15462:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787115128.284522:0:15462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787115128.336754:0:15462:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787115128.336764:0:15462:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787115128.336801:0:15462:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787115128.336876:0:15462:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.110@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787115128.336892:0:15462:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787115128.336926:0:15462:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787115129.290993:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787115129.733516:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787115129.733543:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624662528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787115129.733632:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115129.733710:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624662528 00000100:00100000:1.0:1787115129.733720:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624662528 00000100:00100000:1.0:1787115129.733773:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787115129.733782:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1873925624662528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787115129.733824:0:14797:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787115129.733885:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1873925624662528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115129.733892:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787115129.733947:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624662528:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1787115129.797890:0:14155:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787115129.797902:0:14155:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8af07b587800 from 8 10000000:01000000:1.0:1787115129.798057:0:14155:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787115129.798145:0:14155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1800/0x194cd781e88c95f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115129.798157:0:14155:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1800/0x194cd781e88c95f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115129.798170:0:14155:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1800/0x194cd781e88c95f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115129.798197:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624662656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787115129.798275:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115129.798322:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af05908ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787115129.799622:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624662656 00000100:00100000:2.0:1787115129.799637:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624662656 00000100:00100000:2.0:1787115129.799708:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787115129.799717:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+18:14155:x1873925624662656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787115129.799733:0:14153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115129.799750:0:14153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af08216e800/0x194cd781e88c95f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c95f0 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115129.799773:0:14153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af08216e800/0x194cd781e88c95f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c95f0 expref: 19 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115129.799794:0:14153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af08216e800/0x194cd781e88c95f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c95f0 expref: 19 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115129.799803:0:14153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216e800, rc 0) 00000100:00100000:2.0:1787115129.799887:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043100450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:14155:x1873925624662656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115129.799894:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787115129.801722:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624662656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787115129.801749:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1800/0x194cd781e88c95f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c95f7 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115129.801762:0:14155:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1800/0x194cd781e88c95f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c95f7 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115129.801858:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f7e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624662784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787115129.801932:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115129.801972:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af05908ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787115129.802066:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624662784 00000100:00100000:3.0:1787115129.802084:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624662784 00000100:00100000:3.0:1787115129.802150:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787115129.802159:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043102050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:14155:x1873925624662784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787115129.802179:0:14151:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787115129.802196:0:14151:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787115129.802202:0:14151:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1787115129.802313:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043102050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:14155:x1873925624662784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 156us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115129.802321:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787115129.804740:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f7e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624662784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787115129.804834:0:14155:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787115129.804853:0:14155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1800/0x194cd781e88c95f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c95f7 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115129.804877:0:14155:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1800/0x194cd781e88c95f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c95f7 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1787115129.881506:0:6604:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787115129.881525:0:6604:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1787115130.309792:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115131.339429:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115132.361178:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787115132.746522:0:14191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1787115133.317227:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787115133.317238:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787115133.317241:0:36:0:(import.c:65:import_set_state_nolock()) ffff8af05032f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787115133.317255:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8af05032f000 using connection 192.168.202.110@tcp/0@lo 00000100:00100000:3.0:1787115133.317278:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af0513aa300 x1873925624663168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787115133.317364:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137037ef-42b3-4c5c-b74a-b929b53d47b0:3306:1873925624662912:0@lo:400:kworker.0 00000100:00100000:3.0:1787115133.317440:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115133.317505:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624663552:0@lo:400:kworker.0 00000100:00100000:3.0:1787115133.317528:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115133.317552:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787115133.317556:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624663040:0@lo:400:kworker.0 00000100:00100000:3.0:1787115133.317579:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115133.317622:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624663168:0@lo:8:kworker.0 00000100:00100000:3.0:1787115133.317650:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115133.317679:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624663424:0@lo:400:kworker.0 00000100:00100000:3.0:1787115133.317704:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115133.317725:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787115133.317730:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624663296:0@lo:400:kworker.0 00000100:00100000:3.0:1787115133.317749:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115133.317780:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624662912 00000100:00100000:3.0:1787115133.317787:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624662912 00000100:00100000:3.0:1787115133.317842:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787115133.317851:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:3306:x1873925624662912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115133.317908:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:3306:x1873925624662912:12345-0@lo:400:kworker.0 Request processed in 59us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115133.317915:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787115133.317949:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624663552 00000100:00100000:3.0:1787115133.317952:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624663552 00000100:00100000:3.0:1787115133.317979:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624663424 00000100:00100000:3.0:1787115133.317982:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624663424 00000100:00100000:3.0:1787115133.317991:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624663296 00000100:00100000:3.0:1787115133.317993:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624663296 00000100:00100000:3.0:1787115133.318002:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787115133.318007:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624663552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115133.318039:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624663552:12345-0@lo:400:kworker.0 Request processed in 31us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115133.318044:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787115133.318054:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787115133.318059:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624663424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115133.318096:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624663424:12345-0@lo:400:kworker.0 Request processed in 37us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115133.318102:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787115133.318133:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787115133.318139:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624663296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115133.318163:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873925624663296:12345-0@lo:400:kworker.0 Request processed in 24us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115133.318168:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787115133.318182:0:14795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624663040 00000100:00100000:3.0:1787115133.318185:0:14795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624663040 00000100:00100000:3.0:1787115133.318204:0:14795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624663168 00000100:00100000:3.0:1787115133.318207:0:14795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624663168 00000100:00100000:3.0:1787115133.318219:0:14795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787115133.318224:0:14795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624663040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115133.318251:0:14795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624663040:12345-0@lo:400:kworker.0 Request processed in 27us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115133.318257:0:14795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787115133.318267:0:14795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787115133.318271:0:14795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1873925624663168:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787115133.318294:0:14795:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:3.0:1787115133.318319:0:14795:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x194cd781e88c95fe 00002000:00100000:3.0:1787115133.318334:0:14795:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8aef43ed2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113803 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787115133.318339:0:14795:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787115133.318342:0:14795:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787115133.318686:0:14795:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787115133.318713:0:14795:0:(import.c:65:import_set_state_nolock()) ffff8aef43ed5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787115133.318770:0:14795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1873925624663168:12345-0@lo:8:kworker.0 Request processed in 497us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115133.318777:0:14795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787115133.324167:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af0513abb80 x1873925624663296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787115149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787115133.324193:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873925624663296:0@lo:400:kworker.0 00010000:00080000:0.0:1787115133.324213:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af0513ab100 x1873925624663424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787115149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787115133.324230:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624663424:0@lo:400:kworker.0 00000100:00100000:0.0:1787115133.324280:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787115133.324290:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624663040:0@lo:400:kworker.0 00000100:00100000:0.0:1787115133.324301:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137037ef-42b3-4c5c-b74a-b929b53d47b0:3306:1873925624662912:0@lo:400:kworker.0 00010000:00080000:0.0:1787115133.324326:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af0513a8a80 x1873925624663552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787115149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787115133.324335:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624663552:0@lo:400:kworker.0 00010000:00080000:2.0:1787115133.330452:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af0513aa300 x1873925624663168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787115158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787115133.330477:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787115133.330486:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787115133.330513:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787115133.330518:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8af05032f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787115133.330540:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787115133.330549:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873925624663168:0@lo:8:kworker.0 00000004:00080000:2.0:1787115133.330637:0:14182:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1787115133.330684:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14182:1873925624663808:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787115133.330750:0:14182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115133.330778:0:14182:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af044f4a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787115133.330797:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787115133.330818:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624663680:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1787115133.332704:0:14181:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1787115133.334125:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115133.334225:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624663680 00000100:00100000:2.0:1787115133.334235:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624663680 00000100:00100000:2.0:1787115133.334292:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787115133.334303:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1873925624663680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787115133.334345:0:14797:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787115133.334412:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1873925624663680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115133.334419:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787115133.334467:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8af07f6c2300 x1873925624663680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787115149 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787115133.334490:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624663680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787115133.335555:0:14795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624663808 00000100:00100000:3.0:1787115133.335578:0:14795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624663808 00000100:00100000:3.0:1787115133.335618:0:14795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787115133.335625:0:14795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14182:x1873925624663808:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787115133.337353:0:14181:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 462323242076ns, next at 0ns, rc = 0 00002000:00080000:3.0:1787115133.339614:0:14795:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787115133.339626:0:14795:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787115133.339631:0:14795:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000100:00080000:2.0:1787115133.353821:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787115133.353832:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787115133.354784:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00010000:3.0:1787115133.357318:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.357330:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027307541/0x194cd781e88c9605 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.357349:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.357354:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.357361:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027307541/0x194cd781e88c9605 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.357381:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027307541/0x194cd781e88c9605 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.357392:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027307541/0x194cd781e88c9605 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.357401:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027307541/0x194cd781e88c9605 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.357432:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787115133.359615:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.359628:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094f56878/0x194cd781e88c960c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.359649:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.359654:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.359660:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094f56878/0x194cd781e88c960c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.359675:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094f56878/0x194cd781e88c960c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.359686:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094f56878/0x194cd781e88c960c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.359694:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094f56878/0x194cd781e88c960c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.359715:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787115133.360410:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.360418:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037cec37a/0x194cd781e88c9613 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.360430:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.360440:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.360445:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037cec37a/0x194cd781e88c9613 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.360457:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037cec37a/0x194cd781e88c9613 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.360466:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037cec37a/0x194cd781e88c9613 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.360474:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037cec37a/0x194cd781e88c9613 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.360483:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787115133.360883:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.360890:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d30ea05/0x194cd781e88c961a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.360899:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.360903:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.360907:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d30ea05/0x194cd781e88c961a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.360917:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d30ea05/0x194cd781e88c961a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.360925:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d30ea05/0x194cd781e88c961a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.360936:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d30ea05/0x194cd781e88c961a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.360944:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787115133.361351:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.361356:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc3f48b5/0x194cd781e88c9621 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.361365:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.361368:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.361372:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc3f48b5/0x194cd781e88c9621 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.361380:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc3f48b5/0x194cd781e88c9621 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.361388:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc3f48b5/0x194cd781e88c9621 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.361394:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc3f48b5/0x194cd781e88c9621 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.361401:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1787115133.361846:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.361852:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce95a872/0x194cd781e88c9628 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.361867:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.361870:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.361874:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce95a872/0x194cd781e88c9628 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.361885:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce95a872/0x194cd781e88c9628 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.361892:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce95a872/0x194cd781e88c9628 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.361900:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce95a872/0x194cd781e88c9628 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.361909:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1787115133.362327:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.362333:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bf652f6/0x194cd781e88c962f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.362342:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.362345:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.362348:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bf652f6/0x194cd781e88c962f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.362356:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bf652f6/0x194cd781e88c962f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.367833:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787115133.367858:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027307541/0x194cd781e88c9605 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.367874:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682e00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115133.367879:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027307541/0x194cd781e88c9605 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.367890:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027307541/0x194cd781e88c9605 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.367914:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027307541/0x194cd781e88c9605 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.369211:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bf652f6/0x194cd781e88c962f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.369220:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007bf652f6/0x194cd781e88c962f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.369234:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1787115133.370480:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.370493:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c9636 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.370510:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.370515:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.370521:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c9636 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.370536:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c9636 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.370545:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c9636 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.370552:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c9636 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.370571:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:2.0:1787115133.371448:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027307541/0x194cd781e88c9605 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371477:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1787115133.371482:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094f56878/0x194cd781e88c960c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371490:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682800 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115133.371495:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094f56878/0x194cd781e88c960c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371507:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094f56878/0x194cd781e88c960c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371527:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094f56878/0x194cd781e88c960c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371534:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094f56878/0x194cd781e88c960c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371546:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787115133.371550:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037cec37a/0x194cd781e88c9613 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371556:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041683e00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115133.371564:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037cec37a/0x194cd781e88c9613 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371573:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037cec37a/0x194cd781e88c9613 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371584:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037cec37a/0x194cd781e88c9613 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371590:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037cec37a/0x194cd781e88c9613 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371605:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787115133.371609:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d30ea05/0x194cd781e88c961a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371616:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041683800 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115133.371619:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d30ea05/0x194cd781e88c961a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371628:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d30ea05/0x194cd781e88c961a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371637:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d30ea05/0x194cd781e88c961a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371644:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d30ea05/0x194cd781e88c961a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371663:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787115133.371667:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc3f48b5/0x194cd781e88c9621 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371673:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041683200 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115133.371676:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc3f48b5/0x194cd781e88c9621 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371684:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc3f48b5/0x194cd781e88c9621 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371693:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc3f48b5/0x194cd781e88c9621 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371700:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc3f48b5/0x194cd781e88c9621 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371711:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787115133.371714:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce95a872/0x194cd781e88c9628 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371720:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682c00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115133.371724:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce95a872/0x194cd781e88c9628 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371741:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce95a872/0x194cd781e88c9628 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371751:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce95a872/0x194cd781e88c9628 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371757:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce95a872/0x194cd781e88c9628 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371784:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787115133.371788:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007bf652f6/0x194cd781e88c962f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371794:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040031600 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115133.371797:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007bf652f6/0x194cd781e88c962f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.371804:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007bf652f6/0x194cd781e88c962f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.374006:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007bf652f6/0x194cd781e88c962f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.374034:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bf652f6/0x194cd781e88c962f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.374073:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115133.374078:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c9636 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.374085:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030400 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115133.374090:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c9636 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.374101:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c9636 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.374134:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c9636 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.374142:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065d0c5f9/0x194cd781e88c9636 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.374156:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115133.374158:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115133.374160:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787115133.375260:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.375272:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5012/0x194cd781e88c963d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.375305:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.375317:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.375323:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5012/0x194cd781e88c963d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.375348:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5012/0x194cd781e88c963d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.375357:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5012/0x194cd781e88c963d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.375379:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5012/0x194cd781e88c963d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.375426:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787115133.375752:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115133.375759:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5012/0x194cd781e88c963d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.375797:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040031000 already unused, calling callback (ffffffffc14e0300) 00002000:00010000:3.0:1787115133.380253:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.380267:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c9644 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.380285:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.380297:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.380304:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c9644 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.380321:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c9644 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.380332:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c9644 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.380339:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c9644 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.380352:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787115133.384273:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5012/0x194cd781e88c963d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.384290:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5012/0x194cd781e88c963d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.384311:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5012/0x194cd781e88c963d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.384319:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5012/0x194cd781e88c963d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.384343:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115133.384347:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c9644 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.384354:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030a00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115133.384357:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c9644 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.384364:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c9644 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.384374:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c9644 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.384381:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a8e5f19/0x194cd781e88c9644 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.384403:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115133.384405:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115133.384407:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115133.384414:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787115133.385215:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.385225:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c964b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.385240:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.385245:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.385252:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c964b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.385267:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c964b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.385278:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c964b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.385293:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c964b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.385316:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787115133.385769:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.385775:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c9652 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.385785:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.385788:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.385792:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c9652 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.385803:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c9652 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.385823:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c9652 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.385831:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c9652 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.385853:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787115133.386349:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787115133.386358:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c964b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.386369:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030c00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115133.386373:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c964b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.386383:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c964b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.386404:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c964b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.386412:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c964b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.386436:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115133.386457:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c9652 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.386465:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030200 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115133.386477:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c9652 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.386485:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c9652 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.386495:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c9652 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.386502:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c9652 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.386517:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115133.386519:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115133.386521:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787115133.387708:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.387717:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aefb8597/0x194cd781e88c9659 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.387736:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.387739:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.387743:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aefb8597/0x194cd781e88c9659 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.387754:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aefb8597/0x194cd781e88c9659 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.387761:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aefb8597/0x194cd781e88c9659 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.387768:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aefb8597/0x194cd781e88c9659 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.387795:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787115133.388056:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115133.388063:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aefb8597/0x194cd781e88c9659 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.388071:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030e00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115133.388075:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aefb8597/0x194cd781e88c9659 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.388085:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aefb8597/0x194cd781e88c9659 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.388100:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aefb8597/0x194cd781e88c9659 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.388132:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aefb8597/0x194cd781e88c9659 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.388152:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115133.388154:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115133.388156:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787115133.389684:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.389692:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016fac30c/0x194cd781e88c9660 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.389715:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.389718:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.389723:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016fac30c/0x194cd781e88c9660 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.389733:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016fac30c/0x194cd781e88c9660 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.389749:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016fac30c/0x194cd781e88c9660 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.389754:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016fac30c/0x194cd781e88c9660 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.389775:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787115133.389876:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115133.389882:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016fac30c/0x194cd781e88c9660 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.389892:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cb000 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115133.389896:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016fac30c/0x194cd781e88c9660 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.389905:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016fac30c/0x194cd781e88c9660 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.389921:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016fac30c/0x194cd781e88c9660 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.389938:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016fac30c/0x194cd781e88c9660 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.389957:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115133.389959:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115133.389960:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115133.390599:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787115133.393896:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.393908:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d60c37d/0x194cd781e88c9667 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.393923:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.393986:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.393992:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d60c37d/0x194cd781e88c9667 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.394005:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d60c37d/0x194cd781e88c9667 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.394013:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d60c37d/0x194cd781e88c9667 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.394018:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d60c37d/0x194cd781e88c9667 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.394046:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787115133.394357:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115133.394366:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d60c37d/0x194cd781e88c9667 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.394378:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cb400 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115133.394383:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d60c37d/0x194cd781e88c9667 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.394394:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d60c37d/0x194cd781e88c9667 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.394414:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d60c37d/0x194cd781e88c9667 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.394422:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d60c37d/0x194cd781e88c9667 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115133.394455:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115133.394458:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115133.394460:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787115133.397219:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.397228:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008866a462/0x194cd781e88c966e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.397242:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.397245:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.397250:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008866a462/0x194cd781e88c966e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.397259:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008866a462/0x194cd781e88c966e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.397266:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008866a462/0x194cd781e88c966e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.397271:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008866a462/0x194cd781e88c966e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.397287:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787115133.397739:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.397744:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bece3b3/0x194cd781e88c9675 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.397751:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.397757:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.397760:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bece3b3/0x194cd781e88c9675 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.397769:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bece3b3/0x194cd781e88c9675 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.397777:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bece3b3/0x194cd781e88c9675 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.397783:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bece3b3/0x194cd781e88c9675 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.397800:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787115133.398149:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.398154:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfc0ff16/0x194cd781e88c967c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.398160:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.398163:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.398165:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfc0ff16/0x194cd781e88c967c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.398172:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfc0ff16/0x194cd781e88c967c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.398177:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfc0ff16/0x194cd781e88c967c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.398186:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfc0ff16/0x194cd781e88c967c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.398192:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787115133.398481:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.398485:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eab4dff/0x194cd781e88c9683 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.398491:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.398493:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.398495:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eab4dff/0x194cd781e88c9683 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.398501:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004eab4dff/0x194cd781e88c9683 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.398506:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eab4dff/0x194cd781e88c9683 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.398510:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004eab4dff/0x194cd781e88c9683 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.398515:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787115133.398877:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.398883:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4d8e635/0x194cd781e88c968a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.398898:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.398901:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.398905:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4d8e635/0x194cd781e88c968a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.398914:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4d8e635/0x194cd781e88c968a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.398921:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4d8e635/0x194cd781e88c968a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.398928:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4d8e635/0x194cd781e88c968a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.398937:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1787115133.399378:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.399384:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c9691 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.399392:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.399395:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.399400:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c9691 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.399409:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c9691 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.399425:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c9691 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.399430:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c9691 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.399435:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1787115133.399769:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.399776:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052fff536/0x194cd781e88c9698 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.399784:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.399787:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.399792:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052fff536/0x194cd781e88c9698 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.399801:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052fff536/0x194cd781e88c9698 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.399967:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787115133.399977:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008866a462/0x194cd781e88c966e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.399986:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cb600 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787115133.399990:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008866a462/0x194cd781e88c966e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400001:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008866a462/0x194cd781e88c966e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400030:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008866a462/0x194cd781e88c966e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400038:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008866a462/0x194cd781e88c966e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400062:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787115133.400065:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bece3b3/0x194cd781e88c9675 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400072:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429ca800 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787115133.400075:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bece3b3/0x194cd781e88c9675 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400081:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bece3b3/0x194cd781e88c9675 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400098:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bece3b3/0x194cd781e88c9675 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400104:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bece3b3/0x194cd781e88c9675 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400133:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787115133.400136:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfc0ff16/0x194cd781e88c967c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400142:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cb800 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787115133.400145:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfc0ff16/0x194cd781e88c967c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400152:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfc0ff16/0x194cd781e88c967c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400161:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfc0ff16/0x194cd781e88c967c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400168:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfc0ff16/0x194cd781e88c967c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400179:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787115133.400183:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004eab4dff/0x194cd781e88c9683 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400194:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cbc00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787115133.400197:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004eab4dff/0x194cd781e88c9683 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400204:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004eab4dff/0x194cd781e88c9683 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400215:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004eab4dff/0x194cd781e88c9683 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400221:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004eab4dff/0x194cd781e88c9683 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400235:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787115133.400238:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4d8e635/0x194cd781e88c968a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400243:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cb200 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787115133.400246:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4d8e635/0x194cd781e88c968a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400252:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4d8e635/0x194cd781e88c968a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400260:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4d8e635/0x194cd781e88c968a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400273:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4d8e635/0x194cd781e88c968a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400284:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787115133.400287:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c9691 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400292:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429ca000 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787115133.400295:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c9691 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400301:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c9691 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400309:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c9691 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400315:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a230c0a/0x194cd781e88c9691 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115133.400325:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115133.400327:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115133.400328:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115133.403857:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052fff536/0x194cd781e88c9698 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.403867:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052fff536/0x194cd781e88c9698 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.403905:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787115133.404446:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.404451:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec26a26d/0x194cd781e88c969f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.404461:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.404464:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.404469:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec26a26d/0x194cd781e88c969f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.404479:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec26a26d/0x194cd781e88c969f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.404485:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec26a26d/0x194cd781e88c969f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.404490:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec26a26d/0x194cd781e88c969f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115133.404496:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787115133.404497:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787115133.404506:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052fff536/0x194cd781e88c9698 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115133.404516:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429ca600 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:1.0:1787115133.404521:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052fff536/0x194cd781e88c9698 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115133.404531:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052fff536/0x194cd781e88c9698 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115133.404556:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052fff536/0x194cd781e88c9698 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115133.404576:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052fff536/0x194cd781e88c9698 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115133.404604:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787115133.404607:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec26a26d/0x194cd781e88c969f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115133.404614:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429ca200 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:1.0:1787115133.404618:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec26a26d/0x194cd781e88c969f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115133.404634:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec26a26d/0x194cd781e88c969f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115133.404646:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec26a26d/0x194cd781e88c969f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115133.404654:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec26a26d/0x194cd781e88c969f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115133.404672:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115133.404674:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115133.404676:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787115133.404878:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.404882:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e72b9f81/0x194cd781e88c96a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.404888:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.404894:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.404897:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e72b9f81/0x194cd781e88c96a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.404904:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e72b9f81/0x194cd781e88c96a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.404910:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e72b9f81/0x194cd781e88c96a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.404914:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e72b9f81/0x194cd781e88c96a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.404925:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787115133.405259:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.405263:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2f801d6/0x194cd781e88c96ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.405269:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.405271:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.405274:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2f801d6/0x194cd781e88c96ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.405280:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2f801d6/0x194cd781e88c96ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.405285:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2f801d6/0x194cd781e88c96ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.405295:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2f801d6/0x194cd781e88c96ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.405301:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787115133.405650:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.405655:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030a02baf/0x194cd781e88c96b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.405664:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.405667:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.405672:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030a02baf/0x194cd781e88c96b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.405680:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030a02baf/0x194cd781e88c96b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.405685:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030a02baf/0x194cd781e88c96b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.405690:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030a02baf/0x194cd781e88c96b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.405695:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787115133.406036:0:14795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787115133.406040:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000012baa95/0x194cd781e88c96bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.406051:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787115133.406053:0:14795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115133.406055:0:14795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000012baa95/0x194cd781e88c96bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.406062:0:14795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000012baa95/0x194cd781e88c96bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.406067:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000012baa95/0x194cd781e88c96bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.406071:0:14795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000012baa95/0x194cd781e88c96bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.406077:0:14795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:3.0:1787115133.406263:0:14795:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1787115133.406395:0:14795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14182:x1873925624663808:12345-0@lo:5:osp-pre-1-0.0 Request processed in 70766us (75640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115133.406405:0:14795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787115133.406494:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14182:1873925624663808:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787115133.406508:0:14182:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1787115133.406547:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14182:1873925624663936:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787115133.406576:0:14182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115133.406611:0:14182:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045688b40 going to sleep for 11 seconds 00010000:00010000:3.0:1787115133.406628:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787115133.406635:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e72b9f81/0x194cd781e88c96a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.406644:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cae00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:3.0:1787115133.406650:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e72b9f81/0x194cd781e88c96a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.406660:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e72b9f81/0x194cd781e88c96a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.406677:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e72b9f81/0x194cd781e88c96a6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.406683:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e72b9f81/0x194cd781e88c96a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.406698:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787115133.406701:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2f801d6/0x194cd781e88c96ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.406704:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cbe00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:3.0:1787115133.406707:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2f801d6/0x194cd781e88c96ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.406712:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2f801d6/0x194cd781e88c96ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.406728:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2f801d6/0x194cd781e88c96ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.406733:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2f801d6/0x194cd781e88c96ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.406744:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787115133.406747:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030a02baf/0x194cd781e88c96b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.406750:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af0429cba00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:3.0:1787115133.406753:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030a02baf/0x194cd781e88c96b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115133.406753:0:15476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624663936 00010000:00010000:3.0:1787115133.406761:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030a02baf/0x194cd781e88c96b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115133.406763:0:15476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624663936 00010000:00010000:3.0:1787115133.406772:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030a02baf/0x194cd781e88c96b4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.406779:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030a02baf/0x194cd781e88c96b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.406792:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787115133.406796:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000012baa95/0x194cd781e88c96bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115133.406819:0:15476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787115133.406830:0:15476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14182:x1873925624663936:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787115133.406880:0:15476:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1787115133.407346:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115133.416063:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aef418df600 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:3.0:1787115133.416070:0:14146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000012baa95/0x194cd781e88c96bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.416082:0:14146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000012baa95/0x194cd781e88c96bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.416102:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000012baa95/0x194cd781e88c96bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.416121:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000012baa95/0x194cd781e88c96bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115133.416147:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115133.416149:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115133.416153:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787115133.416401:0:15476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14182:x1873925624663936:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9568us (9819us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787115133.416428:0:15476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787115133.416560:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14182:1873925624663936:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787115133.416573:0:14182:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:2.0:1787115133.430224:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:1.0:1787115133.458960:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787115134.469275:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787115134.854387:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787115134.854412:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624664064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787115134.854500:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115134.855962:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624664064 00000100:00100000:3.0:1787115134.855976:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624664064 00000100:00100000:3.0:1787115134.856102:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787115134.856131:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624664064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787115134.856175:0:14797:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787115134.856278:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624664064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (1778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115134.856294:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787115134.856378:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624664064:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787115135.020482:0:15819:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg210-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787115135.499222:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115136.518271:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787115137.447428:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115137.447529:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602649088 00000100:00100000:0.0:1787115137.447539:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602649088 00000100:00100000:0.0:1787115137.447589:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 73 00000100:00100000:0.0:1787115137.447597:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2360:x1873925602649088:12345-192.168.202.10@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787115137.447631:0:14152:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from e5965936-b623-4bea-9c39-d92821f4f81e@192.168.202.10@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:0.0:1787115137.447680:0:14152:0:(genops.c:1406:class_connect()) connect: client e5965936-b623-4bea-9c39-d92821f4f81e, cookie 0x194cd781e88c96c2 00000100:00080000:0.0:1787115137.447851:0:14152:0:(import.c:65:import_set_state_nolock()) ffff8aef424f5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787115137.447959:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043101450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+5:2360:x1873925602649088:12345-192.168.202.10@tcp:250:mount.lustre.0 Request processed in 360us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115137.447966:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 73 00000100:00100000:0.0:1787115137.478342:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115137.478579:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602649216 00000100:00100000:3.0:1787115137.478590:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602649216 00000100:00100000:3.0:1787115137.478665:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 74 00000100:00100000:3.0:1787115137.478675:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043102c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+5:13707:x1873925602649216:12345-192.168.202.10@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787115137.478703:0:14151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115137.478723:0:14151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aef418dfc00/0x194cd781e88c96c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1806 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115137.478753:0:14151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aef418dfc00/0x194cd781e88c96c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1806 expref: 6 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115137.478766:0:14151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aef418dfc00/0x194cd781e88c96c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1806 expref: 6 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115137.478787:0:14151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aef418dfc00, rc 0) 00000100:00100000:3.0:1787115137.478850:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043102c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+6:13707:x1873925602649216:12345-192.168.202.10@tcp:101:mount.lustre.0 Request processed in 176us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115137.478857:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 74 00000100:00100000:2.0:1787115137.480946:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115137.481134:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602649344 00000100:00100000:3.0:1787115137.481143:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602649344 00000100:00100000:3.0:1787115137.481199:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 75 00000100:00100000:3.0:1787115137.481210:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043101850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+6:13707:x1873925602649344:12345-192.168.202.10@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787115137.481624:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043101850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+6:13707:x1873925602649344:12345-192.168.202.10@tcp:501:mount.lustre.0 Request processed in 415us (694us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787115137.481640:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 75 00000100:00100000:1.0:1787115137.486169:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115137.486268:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602649472 00000100:00100000:0.0:1787115137.486281:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602649472 00000100:00100000:0.0:1787115137.486347:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 76 00000100:00100000:0.0:1787115137.486359:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+6:13707:x1873925602649472:12345-192.168.202.10@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787115137.486382:0:14152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115137.486404:0:14152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af052364400/0x194cd781e88c96d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d180d expref: -99 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115137.486436:0:14152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af052364400/0x194cd781e88c96d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d180d expref: 7 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115137.486449:0:14152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af052364400/0x194cd781e88c96d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d180d expref: 7 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115137.486479:0:14152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052364400, rc 0) 00000100:00100000:0.0:1787115137.486546:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043100c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+7:13707:x1873925602649472:12345-192.168.202.10@tcp:101:mount.lustre.0 Request processed in 189us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115137.486554:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 76 00000100:00100000:2.0:1787115137.493502:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115137.497268:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602649600 00000100:00100000:3.0:1787115137.497285:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602649600 00000100:00100000:3.0:1787115137.497420:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 77 00000100:00100000:3.0:1787115137.497433:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+7:13707:x1873925602649600:12345-192.168.202.10@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787115137.497795:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+8:13707:x1873925602649600:12345-192.168.202.10@tcp:501:mount.lustre.0 Request processed in 364us (4302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115137.497804:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 77 00000100:00100000:2.0:1787115137.508286:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115137.508674:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602649728 00000100:00100000:3.0:1787115137.508694:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602649728 00000100:00100000:3.0:1787115137.508752:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 78 00000100:00100000:3.0:1787115137.508761:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+8:13707:x1873925602649728:12345-192.168.202.10@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787115137.509260:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+8:13707:x1873925602649728:12345-192.168.202.10@tcp:503:mount.lustre.0 Request processed in 496us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115137.509270:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 78 00000100:00100000:1.0:1787115137.514998:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115137.515317:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602649856 00000100:00100000:3.0:1787115137.515328:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602649856 00000100:00100000:3.0:1787115137.515393:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 79 00000100:00100000:3.0:1787115137.515403:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+8:13725:x1873925602649856:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787115137.523517:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+8:13725:x1873925602649856:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 8100us (8515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115137.523534:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 79 00010000:00010000:3.0:1787115137.541291:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787115137.555228:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115137.556586:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602649984 00000100:00100000:0.0:1787115137.556602:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602649984 00000100:00100000:0.0:1787115137.556690:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 80 00000100:00100000:0.0:1787115137.556700:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+8:13725:x1873925602649984:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787115137.557003:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043100050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+8:13725:x1873925602649984:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 303us (1788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115137.557011:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 80 00000100:00100000:0.0:1787115137.565726:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115137.566824:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602650112 00000100:00100000:2.0:1787115137.566838:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602650112 00000100:00100000:2.0:1787115137.566904:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 81 00000100:00100000:2.0:1787115137.566915:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043103c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+8:13707:x1873925602650112:12345-192.168.202.10@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787115137.566933:0:14153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115137.566950:0:14153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af08216e000/0x194cd781e88c96d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1837 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115137.566980:0:14153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af08216e000/0x194cd781e88c96d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1837 expref: 9 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115137.566993:0:14153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af08216e000/0x194cd781e88c96d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1837 expref: 9 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115137.567002:0:14153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216e000, rc 0) 00000100:00100000:2.0:1787115137.567069:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043103c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+9:13707:x1873925602650112:12345-192.168.202.10@tcp:101:mount.lustre.0 Request processed in 156us (1354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115137.567094:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 81 00000100:00100000:1.0:1787115137.582243:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115137.582454:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602650240 00000100:00100000:3.0:1787115137.582467:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602650240 00000100:00100000:3.0:1787115137.582533:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 82 00000100:00100000:3.0:1787115137.582542:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043100850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+9:13707:x1873925602650240:12345-192.168.202.10@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787115137.582588:0:14151:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787115137.582606:0:14151:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787115137.582610:0:14151:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787115137.582613:0:14151:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787115137.582616:0:14151:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787115137.585500:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043100850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+9:13707:x1873925602650240:12345-192.168.202.10@tcp:256:mount.lustre.0 Request processed in 2947us (3262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115137.585516:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 82 00000100:00100000:0.0:1787115137.602856:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115137.604892:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602650368 00000100:00100000:3.0:1787115137.604917:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602650368 00000100:00100000:3.0:1787115137.604984:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 83 00000100:00100000:3.0:1787115137.604994:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+9:13707:x1873925602650368:12345-192.168.202.10@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787115137.605147:0:14152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115137.605175:0:14152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aef418df600/0x194cd781e88c96de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d183e expref: -99 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115137.605206:0:14152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aef418df600/0x194cd781e88c96de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d183e expref: 10 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115137.605217:0:14152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aef418df600/0x194cd781e88c96de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d183e expref: 10 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115137.605226:0:14152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aef418df600, rc 0) 00000100:00100000:3.0:1787115137.605285:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+10:13707:x1873925602650368:12345-192.168.202.10@tcp:101:mount.lustre.0 Request processed in 293us (2437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115137.605292:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 83 00000100:00100000:1.0:1787115137.608235:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115137.608435:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602650496 00000100:00100000:0.0:1787115137.608446:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602650496 00000100:00100000:0.0:1787115137.608507:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 84 00000100:00100000:0.0:1787115137.608518:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af043102850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+10:13707:x1873925602650496:12345-192.168.202.10@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787115137.612233:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af043102850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+10:13707:x1873925602650496:12345-192.168.202.10@tcp:501:mount.lustre.0 Request processed in 3699us (3991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115137.612252:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 84 00000100:00100000:0.0:1787115137.619384:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115137.619568:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602650624 00000100:00100000:2.0:1787115137.619579:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602650624 00000100:00100000:2.0:1787115137.619641:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 85 00000100:00100000:2.0:1787115137.619660:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+10:13707:x1873925602650624:12345-192.168.202.10@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787115137.620163:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+10:13707:x1873925602650624:12345-192.168.202.10@tcp:503:mount.lustre.0 Request processed in 510us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115137.620173:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 85 00000100:00100000:2.0:1787115137.628834:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115137.628940:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602650752 00000100:00100000:0.0:1787115137.628953:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602650752 00000100:00100000:0.0:1787115137.629172:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 86 00000100:00100000:0.0:1787115137.629184:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+10:13729:x1873925602650752:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787115137.629694:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+10:13729:x1873925602650752:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 503us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115137.629703:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 86 00000100:00100000:1.0:1787115137.654477:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115137.654594:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602650880 00000100:00100000:3.0:1787115137.654606:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602650880 00000100:00100000:3.0:1787115137.654692:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 87 00000100:00100000:3.0:1787115137.654703:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+10:13729:x1873925602650880:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787115137.655051:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+10:13729:x1873925602650880:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 348us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115137.655059:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 87 00000100:00100000:0.0:1787115137.671215:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115137.679486:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602651008 00000100:00100000:3.0:1787115137.679504:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602651008 00000100:00100000:3.0:1787115137.679631:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4 00000100:00100000:3.0:1787115137.679640:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2360:x1873925602651008:12345-192.168.202.10@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787115137.679704:0:14159:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 278330ce-de2f-4eb0-ab55-65b736a927fb@192.168.202.10@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:3.0:1787115137.679910:0:14159:0:(genops.c:1406:class_connect()) connect: client 278330ce-de2f-4eb0-ab55-65b736a927fb, cookie 0x194cd781e88c96e5 00000004:00100000:3.0:1787115137.679952:0:14159:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787115137.679960:0:14159:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1787115137.766428:0:14159:0:(import.c:65:import_set_state_nolock()) ffff8aef4265f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787115137.766514:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+6:2360:x1873925602651008:12345-192.168.202.10@tcp:38:mount.lustre.0 Request processed in 86871us (95307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115137.766527:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4 00000100:00100000:0.0:1787115137.769710:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115137.769953:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602651136 00000100:00100000:3.0:1787115137.769964:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602651136 00000100:00100000:3.0:1787115137.770047:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5 00000100:00100000:3.0:1787115137.770059:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+6:0:x1873925602651136:12345-192.168.202.10@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787115137.770141:0:14158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787115137.770224:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+6:0:x1873925602651136:12345-192.168.202.10@tcp:41:mount.lustre.0 Request processed in 169us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115137.770231:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5 00000100:00080000:2.0:1787115137.770358:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787115137.772822:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115137.772975:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602651264 00000100:00100000:1.0:1787115137.773002:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602651264 00000100:00100000:1.0:1787115137.773063:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00100000:1.0:1787115137.773075:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+6:13707:x1873925602651264:12345-192.168.202.10@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787115137.773276:0:14159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787115137.773440:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+6:13707:x1873925602651264:12345-192.168.202.10@tcp:41:mount.lustre.0 Request processed in 367us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115137.773448:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00100000:1.0:1787115137.787372:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115137.787467:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602651392 00000100:00100000:0.0:1787115137.787477:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602651392 00000100:00100000:0.0:1787115137.787538:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:0.0:1787115137.787555:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+6:13707:x1873925602651392:12345-192.168.202.10@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787115137.787646:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+6:13707:x1873925602651392:12345-192.168.202.10@tcp:40:mount.lustre.0 Request processed in 93us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115137.787654:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:0.0:1787115137.790370:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115137.790411:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115137.790492:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602651520 00000100:00100000:2.0:1787115137.790501:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602651520 00000100:00100000:2.0:1787115137.790546:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602651648 00000100:00100000:2.0:1787115137.790550:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602651648 00000100:00100000:2.0:1787115137.790575:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:2.0:1787115137.790583:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1873925602651520:12345-192.168.202.10@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787115137.790616:0:14793:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 278330ce-de2f-4eb0-ab55-65b736a927fb@192.168.202.10@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:2.0:1787115137.790650:0:14793:0:(genops.c:1406:class_connect()) connect: client 278330ce-de2f-4eb0-ab55-65b736a927fb, cookie 0x194cd781e88c96ec 00002000:00100000:2.0:1787115137.790664:0:14793:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 278330ce-de2f-4eb0-ab55-65b736a927fb/ffff8aef428c6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113803 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787115137.790692:0:14793:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787115137.791041:0:14793:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787115137.791076:0:14793:0:(import.c:65:import_set_state_nolock()) ffff8aef428c7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787115137.791355:0:15476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00100000:1.0:1787115137.791362:0:15476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1873925602651648:12345-192.168.202.10@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787115137.791381:0:15476:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 278330ce-de2f-4eb0-ab55-65b736a927fb@192.168.202.10@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:1.0:1787115137.791403:0:15476:0:(genops.c:1406:class_connect()) connect: client 278330ce-de2f-4eb0-ab55-65b736a927fb, cookie 0x194cd781e88c96f3 00002000:00100000:1.0:1787115137.791409:0:15476:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 278330ce-de2f-4eb0-ab55-65b736a927fb/ffff8aef42658000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113803 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787115137.791423:0:15476:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787115137.791563:0:15476:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787115137.791580:0:15476:0:(import.c:65:import_set_state_nolock()) ffff8aef4265b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787115137.791634:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+6:2360:x1873925602651520:12345-192.168.202.10@tcp:8:mount.lustre.0 Request processed in 1049us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115137.791642:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:1.0:1787115137.798121:0:15476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+6:2360:x1873925602651648:12345-192.168.202.10@tcp:8:mount.lustre.0 Request processed in 6735us (7685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115137.798135:0:15476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00100000:0.0:1787115137.806346:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115137.806501:0:14160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602651776 00000100:00100000:2.0:1787115137.806510:0:14160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602651776 00000100:00100000:2.0:1787115137.806556:0:14160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:2.0:1787115137.806563:0:14160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+6:13707:x1873925602651776:12345-192.168.202.10@tcp:33:mount.lustre.0 00000004:00080000:2.0:1787115137.815550:0:14160:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8918us 00000004:00200000:0.0:1787115137.835950:0:14160:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787115137.836205:0:14160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+6:13707:x1873925602651776:12345-192.168.202.10@tcp:33:mount.lustre.0 Request processed in 29634us (29862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115137.836220:0:14160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:2.0:1787115138.050155:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115138.050516:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602651904 00000100:00100000:1.0:1787115138.050526:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602651904 00000100:00100000:1.0:1787115138.050707:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:1.0:1787115138.050718:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+6:13750:x1873925602651904:12345-192.168.202.10@tcp:101:mkdir.0 00010000:00010000:1.0:1787115138.050741:0:14159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115138.050783:0:14159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c96fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1868 expref: -99 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115138.050881:0:14159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c9701 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115138.050895:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c9701 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115138.050911:0:14159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c9701 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787115138.051142:0:14159:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787115138.051147:0:14159:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787115138.052022:0:14159:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c9701 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115138.052066:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0a00/0x194cd781e88c96fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1868 expref: 8 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115138.052087:0:14159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c9701 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1868 expref: 7 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115138.052097:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0510d6e00) 00010000:00010000:1.0:1787115138.052099:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787115138.052103:0:14159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0600, rc 0) 00000100:00100000:1.0:1787115138.052385:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+7:13750:x1873925602651904:12345-192.168.202.10@tcp:101:mkdir.0 Request processed in 1668us (2278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115138.052393:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:2.0:1787115138.437579:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624664320:0@lo:400:kworker.0 00000100:00100000:3.0:1787115138.437606:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624664448:0@lo:400:kworker.0 00000100:00100000:1.0:1787115138.437850:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137037ef-42b3-4c5c-b74a-b929b53d47b0:3309:1873925624664192:0@lo:400:kworker.0 00000100:00100000:0.0:1787115138.447973:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624664576:0@lo:400:kworker.0 00000100:00100000:3.0:1787115138.450943:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115138.451053:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624664960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787115138.451101:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115138.451141:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787115138.451165:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873925624664832:0@lo:400:kworker.0 00000100:00100000:3.0:1787115138.451195:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115138.451239:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624664832 00000100:00100000:3.0:1787115138.451247:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624664832 00000100:00100000:3.0:1787115138.451306:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787115138.451317:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873925624664832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115138.451380:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873925624664832:12345-0@lo:400:kworker.0 Request processed in 66us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115138.451388:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787115138.451437:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873925624664832:0@lo:400:kworker.0 00000100:00100000:3.0:1787115138.451483:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624664960 00000100:00100000:3.0:1787115138.451487:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624664960 00000100:00100000:3.0:1787115138.451515:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787115138.451522:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1873925624664960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787115138.451539:0:14798:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787115138.451579:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1873925624664960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115138.451586:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787115138.451602:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624664448 00000100:00100000:3.0:1787115138.451605:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624664448 00000100:00100000:3.0:1787115138.451630:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787115138.451636:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1873925624664448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115138.451670:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1873925624664448:12345-0@lo:400:kworker.0 Request processed in 34us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115138.451676:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787115138.451711:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624664960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787115138.451733:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624664448:0@lo:400:kworker.0 00000100:00080000:3.0:1787115138.451773:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787115138.451778:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787115138.451805:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115138.451840:0:14795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624664320 00000100:00100000:2.0:1787115138.451844:0:14795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624664320 00000100:00100000:2.0:1787115138.451876:0:14795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787115138.451882:0:14795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624664320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115138.451917:0:14795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624664320:12345-0@lo:400:kworker.0 Request processed in 36us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115138.451923:0:14795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787115138.451944:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787115138.451961:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624664320:0@lo:400:kworker.0 00000100:00100000:1.0:1787115138.452144:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115138.452178:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624664192 00000100:00100000:1.0:1787115138.452182:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624664192 00000100:00100000:1.0:1787115138.452209:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787115138.452215:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:3309:x1873925624664192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787115138.452248:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:3309:x1873925624664192:12345-0@lo:400:kworker.0 Request processed in 33us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115138.452254:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787115138.452297:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137037ef-42b3-4c5c-b74a-b929b53d47b0:3309:1873925624664192:0@lo:400:kworker.0 00000100:00100000:1.0:1787115138.452306:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624664704:0@lo:400:kworker.0 00000100:00100000:1.0:1787115138.452332:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115138.452353:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624664704 00000100:00100000:1.0:1787115138.452356:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624664704 00000100:00100000:1.0:1787115138.452387:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787115138.452392:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624664704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787115138.452435:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624664704:12345-0@lo:400:kworker.0 Request processed in 43us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115138.452441:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787115138.452463:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624664704:0@lo:400:kworker.0 00000100:00080000:2.0:1787115138.452750:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787115138.452850:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115138.452938:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624664576 00000100:00100000:2.0:1787115138.452942:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624664576 00000100:00100000:2.0:1787115138.452974:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787115138.452981:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624664576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115138.453018:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624664576:12345-0@lo:400:kworker.0 Request processed in 38us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115138.453024:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787115138.453097:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624664576:0@lo:400:kworker.0 00010000:00010000:2.0:1787115138.566411:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787115138.569439:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 278330ce-de2f-4eb0-ab55-65b736a927fb 00000001:00080000:2.0:1787115138.569462:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:3.0:1787115139.589288:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787115139.974273:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787115139.974302:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624665088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787115139.974382:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115139.974593:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624665088 00000100:00100000:3.0:1787115139.974602:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624665088 00000100:00100000:3.0:1787115139.974662:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787115139.974673:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624665088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787115139.974711:0:14798:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787115139.974796:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624665088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115139.974805:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787115139.974833:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624665088:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787115140.017305:0:6604:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 278330ce-de2f-4eb0-ab55-65b736a927fb 00000100:00100000:2.0:1787115140.071231:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115140.071424:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602652032 00000100:00100000:1.0:1787115140.071437:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602652032 00000100:00100000:1.0:1787115140.071520:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00100000:1.0:1787115140.071531:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+7:13802:x1873925602652032:12345-192.168.202.10@tcp:41:lfs.0 00000004:00000024:1.0:1787115140.071577:0:14158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787115140.071682:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+7:13802:x1873925602652032:12345-192.168.202.10@tcp:41:lfs.0 Request processed in 152us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115140.071699:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00080000:2.0:1787115140.071964:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787115140.075581:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115140.080129:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602652160 00000100:00100000:2.0:1787115140.080146:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602652160 00000100:00100000:2.0:1787115140.080293:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00100000:2.0:1787115140.080304:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:278330ce-de2f-4eb0-ab55-65b736a927fb+5:13802:x1873925602652160:12345-192.168.202.10@tcp:13:lfs.0 00002000:00000024:2.0:1787115140.080335:0:14797:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787115140.080439:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:278330ce-de2f-4eb0-ab55-65b736a927fb+5:13802:x1873925602652160:12345-192.168.202.10@tcp:13:lfs.0 Request processed in 136us (4869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115140.080447:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00100000:3.0:1787115140.082933:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115140.083671:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602652288 00000100:00100000:2.0:1787115140.083685:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602652288 00000100:00080000:0.0:1787115140.083827:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787115140.083833:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787115140.084087:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:2.0:1787115140.084099:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:278330ce-de2f-4eb0-ab55-65b736a927fb+5:13802:x1873925602652288:12345-192.168.202.10@tcp:13:lfs.0 00002000:00000024:2.0:1787115140.084166:0:14797:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787115140.084290:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:278330ce-de2f-4eb0-ab55-65b736a927fb+5:13802:x1873925602652288:12345-192.168.202.10@tcp:13:lfs.0 Request processed in 193us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115140.084298:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:1.0:1787115140.338428:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115140.338551:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602652416 00000100:00100000:3.0:1787115140.338720:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602652416 00000100:00100000:3.0:1787115140.338813:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 89 00000100:00100000:3.0:1787115140.338828:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+10:13837:x1873925602652416:12345-192.168.202.10@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787115140.338855:0:14153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115140.338887:0:14153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aef418dfa00/0x194cd781e88c9708 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d186f expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115140.339051:0:14153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aef418dfa00/0x194cd781e88c9708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d186f expref: 11 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115140.339067:0:14153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aef418dfa00/0x194cd781e88c9708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d186f expref: 11 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115140.339098:0:14153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aef418dfa00, rc 0) 00000100:00100000:3.0:1787115140.339222:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+11:13837:x1873925602652416:12345-192.168.202.10@tcp:101:mount.lustre.0 Request processed in 398us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115140.339229:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 89 00000100:00100000:1.0:1787115140.348852:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115140.349069:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602652544 00000100:00100000:3.0:1787115140.349083:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602652544 00000100:00100000:3.0:1787115140.349179:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 90 00000100:00100000:3.0:1787115140.349189:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+11:13837:x1873925602652544:12345-192.168.202.10@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787115140.349914:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+11:13837:x1873925602652544:12345-192.168.202.10@tcp:501:mount.lustre.0 Request processed in 715us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115140.349925:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 90 00000100:00100000:2.0:1787115140.359497:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115140.359757:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602652672 00000100:00100000:3.0:1787115140.359768:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602652672 00000100:00100000:3.0:1787115140.359826:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 91 00000100:00100000:3.0:1787115140.359835:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+11:13837:x1873925602652672:12345-192.168.202.10@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787115140.360152:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+11:13837:x1873925602652672:12345-192.168.202.10@tcp:503:mount.lustre.0 Request processed in 316us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115140.360160:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 91 00000100:00100000:1.0:1787115140.373084:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115140.375803:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602652800 00000100:00100000:3.0:1787115140.375822:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602652800 00000100:00100000:3.0:1787115140.376140:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 92 00000100:00100000:3.0:1787115140.376155:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+11:13843:x1873925602652800:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787115140.376540:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+11:13843:x1873925602652800:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 388us (3464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115140.376560:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 92 00000100:00100000:0.0:1787115140.409851:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115140.409951:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602652928 00000100:00100000:1.0:1787115140.409960:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602652928 00000100:00100000:1.0:1787115140.410011:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 93 00000100:00100000:1.0:1787115140.410020:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+11:13843:x1873925602652928:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787115140.410348:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+11:13843:x1873925602652928:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 327us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115140.410356:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 93 00000100:00100000:0.0:1787115140.412811:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115140.412902:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602653056 00000100:00100000:3.0:1787115140.412921:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602653056 00000100:00100000:3.0:1787115140.412973:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 94 00000100:00100000:3.0:1787115140.412986:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+11:13837:x1873925602653056:12345-192.168.202.10@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787115140.413002:0:14152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115140.413023:0:14152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aef418df800/0x194cd781e88c970f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1899 expref: -99 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115140.413052:0:14152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aef418df800/0x194cd781e88c970f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1899 expref: 12 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115140.413063:0:14152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aef418df800/0x194cd781e88c970f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1899 expref: 12 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115140.413072:0:14152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aef418df800, rc 0) 00000100:00100000:3.0:1787115140.413157:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+12:13837:x1873925602653056:12345-192.168.202.10@tcp:101:mount.lustre.0 Request processed in 174us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115140.413164:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 94 00000100:00100000:2.0:1787115140.418612:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115140.422048:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602653184 00000100:00100000:3.0:1787115140.422067:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602653184 00000100:00100000:2.0:1787115140.424409:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 95 00000100:00100000:2.0:1787115140.424426:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+12:13837:x1873925602653184:12345-192.168.202.10@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787115140.424456:0:14153:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787115140.424484:0:14153:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787115140.424488:0:14153:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787115140.424492:0:14153:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787115140.424494:0:14153:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787115140.426493:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+12:13837:x1873925602653184:12345-192.168.202.10@tcp:256:mount.lustre.0 Request processed in 2061us (7883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115140.426506:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 95 00000100:00100000:0.0:1787115140.429299:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115140.429388:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602653312 00000100:00100000:1.0:1787115140.429398:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602653312 00000100:00100000:1.0:1787115140.429448:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 96 00000100:00100000:1.0:1787115140.429458:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+12:13837:x1873925602653312:12345-192.168.202.10@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787115140.429477:0:14151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115140.429493:0:14151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af07b6a0e00/0x194cd781e88c9716 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d18a0 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115140.429521:0:14151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af07b6a0e00/0x194cd781e88c9716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18a0 expref: 13 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115140.429532:0:14151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af07b6a0e00/0x194cd781e88c9716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18a0 expref: 13 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115140.429541:0:14151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0e00, rc 0) 00000100:00100000:1.0:1787115140.429591:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+13:13837:x1873925602653312:12345-192.168.202.10@tcp:101:mount.lustre.0 Request processed in 135us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115140.429616:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 96 00000100:00100000:1.0:1787115140.431565:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115140.431703:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602653440 00000100:00100000:2.0:1787115140.431712:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602653440 00000100:00100000:2.0:1787115140.431775:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 97 00000100:00100000:2.0:1787115140.431784:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+13:13837:x1873925602653440:12345-192.168.202.10@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787115140.432252:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+13:13837:x1873925602653440:12345-192.168.202.10@tcp:501:mount.lustre.0 Request processed in 468us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115140.432261:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 97 00000100:00100000:0.0:1787115140.439254:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115140.439414:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602653568 00000100:00100000:3.0:1787115140.439423:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602653568 00000100:00100000:3.0:1787115140.439477:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 98 00000100:00100000:3.0:1787115140.439484:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+13:13837:x1873925602653568:12345-192.168.202.10@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787115140.439718:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+13:13837:x1873925602653568:12345-192.168.202.10@tcp:503:mount.lustre.0 Request processed in 234us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115140.439731:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 98 00000100:00100000:0.0:1787115140.449897:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115140.453121:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602653696 00000100:00100000:1.0:1787115140.453138:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602653696 00000100:00100000:1.0:1787115140.453212:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 99 00000100:00100000:1.0:1787115140.453223:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af077c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+13:13846:x1873925602653696:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787115140.453538:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af077c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+13:13846:x1873925602653696:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 316us (3650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115140.453546:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 99 00000100:00100000:1.0:1787115140.463301:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115140.465163:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602653824 00000100:00100000:2.0:1787115140.465184:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602653824 00000100:00100000:2.0:1787115140.465264:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 100 00000100:00100000:2.0:1787115140.465275:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af061de7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+13:13846:x1873925602653824:12345-192.168.202.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787115140.465578:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af061de7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+13:13846:x1873925602653824:12345-192.168.202.10@tcp:502:llog_process_th.0 Request processed in 304us (2286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115140.465587:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 100 00000100:00100000:0.0:1787115140.481802:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115140.481855:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115140.481882:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115140.481937:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115140.481964:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115140.482014:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602654720 00000100:00100000:0.0:1787115140.482025:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602654720 00000100:00100000:1.0:1787115140.482036:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602653952 00000100:00100000:1.0:1787115140.482043:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602653952 00000100:00100000:0.0:1787115140.482074:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602654592 00000100:00100000:1.0:1787115140.482078:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602654464 00000100:00100000:0.0:1787115140.482080:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602654592 00000100:00100000:1.0:1787115140.482083:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602654464 00000100:00100000:0.0:1787115140.482149:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4 00000100:00100000:1.0:1787115140.482156:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 14 00000100:00100000:0.0:1787115140.482164:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+5:2362:x1873925602654720:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787115140.482170:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+7:2362:x1873925602654464:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787115140.482283:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5 00000100:00100000:2.0:1787115140.482294:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+5:2362:x1873925602654592:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787115140.482376:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+5:2362:x1873925602654720:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 216us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115140.482384:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4 00000100:00100000:3.0:1787115140.488212:0:14157:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787115140.488233:0:14157:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787115140.488271:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602654336 00000100:00100000:3.0:1787115140.488281:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602654336 00000100:00100000:3.0:1787115140.488354:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 101 00000100:00100000:3.0:1787115140.488365:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af050301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+13:2362:x1873925602654336:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787115140.492406:0:14158:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787115140.492436:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 10 00000100:00100000:1.0:1787115140.492446:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1873925602653952:12345-192.168.202.10@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787115140.492481:0:14158:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1@192.168.202.10@tcp t0 exp 0000000000000000 cur 469 last 0 00000100:00100000:2.0:1787115140.492492:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+5:2362:x1873925602654592:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 10197us (10522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115140.492503:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5 00000020:00000080:1.0:1787115140.492522:0:14158:0:(genops.c:1406:class_connect()) connect: client 68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1, cookie 0x194cd781e88c971d 00000004:00100000:1.0:1787115140.492557:0:14158:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787115140.492682:0:14158:0:(import.c:65:import_set_state_nolock()) ffff8aef4265e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787115140.492734:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+6:2360:x1873925602653952:12345-192.168.202.10@tcp:38:mount.lustre.0 Request processed in 289us (10948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115140.492770:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 10 00000100:00100000:1.0:1787115140.492805:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+7:2362:x1873925602654464:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 10641us (10950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115140.492812:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 14 00000100:00100000:3.0:1787115140.493862:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af050301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+13:2362:x1873925602654336:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 5490us (11914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115140.493879:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 101 00000100:00100000:0.0:1787115140.500926:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115140.501032:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602654080 00000100:00100000:1.0:1787115140.501042:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602654080 00000100:00100000:1.0:1787115140.501193:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00100000:1.0:1787115140.501205:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+6:0:x1873925602654080:12345-192.168.202.10@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787115140.501237:0:14158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787115140.501323:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+6:0:x1873925602654080:12345-192.168.202.10@tcp:41:mount.lustre.0 Request processed in 121us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115140.501331:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00080000:0.0:1787115140.504869:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787115140.508792:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115140.508913:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602654208 00000100:00100000:2.0:1787115140.508924:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602654208 00000100:00100000:2.0:1787115140.508989:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12 00000100:00100000:2.0:1787115140.508999:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+6:13837:x1873925602654208:12345-192.168.202.10@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787115140.509034:0:14157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787115140.509283:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+6:13837:x1873925602654208:12345-192.168.202.10@tcp:41:mount.lustre.0 Request processed in 285us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115140.509292:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12 00000100:00100000:3.0:1787115140.517436:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115140.517662:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602654848 00000100:00100000:1.0:1787115140.517673:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602654848 00000100:00100000:1.0:1787115140.517736:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:1.0:1787115140.517757:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+6:13837:x1873925602654848:12345-192.168.202.10@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787115140.517853:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+6:13837:x1873925602654848:12345-192.168.202.10@tcp:40:mount.lustre.0 Request processed in 98us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115140.517861:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:0.0:1787115140.523170:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115140.523671:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602654976 00000100:00100000:3.0:1787115140.523683:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602654976 00000100:00100000:3.0:1787115140.523792:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 10 00000100:00100000:3.0:1787115140.523801:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1873925602654976:12345-192.168.202.10@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787115140.523836:0:14796:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1@192.168.202.10@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:3.0:1787115140.523871:0:14796:0:(genops.c:1406:class_connect()) connect: client 68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1, cookie 0x194cd781e88c9724 00002000:00100000:3.0:1787115140.523882:0:14796:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1/ffff8aef43ed1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113803 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787115140.523895:0:14796:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787115140.524197:0:14796:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787115140.524230:0:14796:0:(import.c:65:import_set_state_nolock()) ffff8aef43ed0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787115140.524316:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+6:2360:x1873925602654976:12345-192.168.202.10@tcp:8:mount.lustre.0 Request processed in 514us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115140.524325:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 10 00000100:00100000:1.0:1787115140.524418:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115140.524480:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602655232 00000100:00100000:1.0:1787115140.524484:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602655232 00000100:00100000:1.0:1787115140.524515:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1 00000100:00100000:1.0:1787115140.524522:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+6:13837:x1873925602655232:12345-192.168.202.10@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787115140.524702:0:14161:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787115140.524827:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+6:13837:x1873925602655232:12345-192.168.202.10@tcp:33:mount.lustre.0 Request processed in 305us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115140.524835:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1 00000100:00100000:1.0:1787115140.524955:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115140.549236:0:14795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602655104 00000100:00100000:2.0:1787115140.549253:0:14795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602655104 00000100:00100000:2.0:1787115140.549342:0:14795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00100000:2.0:1787115140.549353:0:14795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1873925602655104:12345-192.168.202.10@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787115140.549394:0:14795:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1@192.168.202.10@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:2.0:1787115140.550734:0:14795:0:(genops.c:1406:class_connect()) connect: client 68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1, cookie 0x194cd781e88c972b 00002000:00100000:2.0:1787115140.550760:0:14795:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1/ffff8aef428c4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113803 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787115140.550773:0:14795:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787115140.551018:0:14795:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787115140.551053:0:14795:0:(import.c:65:import_set_state_nolock()) ffff8aef428c5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787115140.551149:0:14795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+6:2360:x1873925602655104:12345-192.168.202.10@tcp:8:mount.lustre.0 Request processed in 1795us (26192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115140.551160:0:14795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11 00010000:00010000:2.0:1787115140.613509:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787115140.666583:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115140.666682:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602655360 00000100:00100000:3.0:1787115140.666705:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602655360 00000100:00100000:3.0:1787115140.666771:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 14 00000100:00100000:3.0:1787115140.666781:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+6:13867:x1873925602655360:12345-192.168.202.10@tcp:101:mkdir.0 00010000:00010000:3.0:1787115140.666802:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115140.666826:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df200/0x194cd781e88c9732 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d18ca expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115140.666889:0:14157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c9739 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115140.667007:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c9739 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115140.667021:0:14157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c9739 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787115140.667344:0:14157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787115140.667349:0:14157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787115140.667429:0:14157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c9739 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115140.667458:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df200/0x194cd781e88c9732 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18ca expref: 8 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115140.667474:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c9739 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18ca expref: 7 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115140.667485:0:14157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0510d6e00) 00010000:00010000:3.0:1787115140.667488:0:14157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787115140.667491:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aef418de600, rc 0) 00000100:00100000:3.0:1787115140.667679:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+7:13867:x1873925602655360:12345-192.168.202.10@tcp:101:mkdir.0 Request processed in 898us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115140.667688:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 14 00010000:00010000:3.0:1787115141.638244:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115142.667607:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787115142.982780:0:14191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1787115143.131530:0:5807:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1 00000001:00100000:3.0:1787115143.131543:0:5807:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 278330ce-de2f-4eb0-ab55-65b736a927fb 00000001:02000400:2.0:1787115143.226627:0:16025:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787115143.557980:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624665216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787115143.558066:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115143.558254:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624665216 00000100:00100000:0.0:1787115143.558264:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624665216 00000100:00100000:0.0:1787115143.558350:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787115143.558359:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624665216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787115143.558395:0:14797:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787115143.558439:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624665216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115143.558445:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787115143.559927:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787115143.559952:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624665600:0@lo:400:kworker.0 00000100:00100000:2.0:1787115143.559969:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624665472:0@lo:400:kworker.0 00000100:00100000:3.0:1787115143.560033:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af07f6c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137037ef-42b3-4c5c-b74a-b929b53d47b0:3306:1873925624665344:0@lo:400:kworker.0 00000100:00100000:0.0:1787115143.560302:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624665728:0@lo:400:kworker.0 00000100:00100000:2.0:1787115143.564747:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787115143.565033:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115143.565137:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624665600 00000100:00100000:2.0:1787115143.565150:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624665600 00000100:00100000:2.0:1787115143.565221:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787115143.565242:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624665600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115143.565320:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873925624665600:12345-0@lo:400:kworker.0 Request processed in 91us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115143.565328:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787115143.565350:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624665472 00000100:00100000:1.0:1787115143.565352:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873925624665600:0@lo:400:kworker.0 00000100:00100000:2.0:1787115143.565353:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624665472 00000100:00100000:2.0:1787115143.565402:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787115143.565410:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624665472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115143.565462:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624665472:12345-0@lo:400:kworker.0 Request processed in 53us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115143.565468:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787115143.565487:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787115143.565508:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624665472:0@lo:400:kworker.0 00000100:00100000:3.0:1787115143.570848:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115143.570935:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624665344 00000100:00100000:3.0:1787115143.570945:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624665344 00000100:00100000:3.0:1787115143.571000:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787115143.571010:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af050303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:3306:x1873925624665344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115143.571076:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af050303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:3306:x1873925624665344:12345-0@lo:400:kworker.0 Request processed in 68us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115143.571083:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787115143.571173:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af07f6c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137037ef-42b3-4c5c-b74a-b929b53d47b0:3306:1873925624665344:0@lo:400:kworker.0 00000100:00100000:3.0:1787115143.571187:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624665856:0@lo:400:kworker.0 00000100:00100000:3.0:1787115143.571219:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115143.571246:0:15938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624665856 00000100:00100000:3.0:1787115143.571249:0:15938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624665856 00000100:00100000:3.0:1787115143.571286:0:15938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787115143.571292:0:15938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624665856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115143.571326:0:15938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873925624665856:12345-0@lo:400:kworker.0 Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115143.571332:0:15938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787115143.571365:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787115143.571390:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873925624665856:0@lo:400:kworker.0 00000100:00100000:0.0:1787115143.571571:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115143.571604:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787115143.571623:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624665216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787115143.571787:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624665728 00000100:00100000:3.0:1787115143.571791:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624665728 00000100:00080000:0.0:1787115143.571852:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787115143.571916:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787115143.571924:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624665728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115143.571975:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624665728:12345-0@lo:400:kworker.0 Request processed in 52us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115143.571981:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787115143.572035:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624665728:0@lo:400:kworker.0 00000001:00100000:3.0:1787115143.591809:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1 00010000:00010000:3.0:1787115143.685512:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787115144.709654:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787115145.097475:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0513a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624665984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787115145.097618:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115145.097734:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624665984 00000100:00100000:0.0:1787115145.097742:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624665984 00000100:00100000:0.0:1787115145.097796:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787115145.097805:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624665984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787115145.097837:0:14797:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787115145.097886:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624665984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115145.097894:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787115145.097914:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787115145.097950:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0513a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624665984:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1787115145.247295:0:6604:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1 00000100:00100000:0.0:1787115145.614622:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115145.614672:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115145.614693:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115145.614726:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115145.614740:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115145.614755:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115145.614777:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115145.614806:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602655744 00000100:00100000:0.0:1787115145.614817:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602655744 00000100:00100000:0.0:1787115145.614865:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602656256 00000100:00100000:0.0:1787115145.614920:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602656256 00000100:00100000:0.0:1787115145.614939:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602655872 00000100:00100000:0.0:1787115145.614941:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602655872 00000100:00100000:0.0:1787115145.614952:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602656128 00000100:00100000:0.0:1787115145.614954:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602656128 00000100:00100000:0.0:1787115145.614970:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:0.0:1787115145.614979:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+5:2361:x1873925602655744:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787115145.615059:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+5:2361:x1873925602655744:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 81us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115145.615067:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:0.0:1787115145.615083:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:0.0:1787115145.615089:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+5:2361:x1873925602656256:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787115145.615127:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+5:2361:x1873925602656256:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 39us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115145.615133:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:0.0:1787115145.615143:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00100000:0.0:1787115145.615148:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+5:2361:x1873925602655872:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787115145.615166:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+5:2361:x1873925602655872:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 18us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115145.615178:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00100000:0.0:1787115145.615188:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 10 00000100:00100000:0.0:1787115145.615193:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+5:2361:x1873925602656128:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787115145.615211:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+5:2361:x1873925602656128:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 19us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115145.615217:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 10 00000100:00100000:0.0:1787115145.615232:0:15938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602656000 00000100:00100000:0.0:1787115145.615235:0:15938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602656000 00000100:00100000:0.0:1787115145.615257:0:15938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602655616 00000100:00100000:0.0:1787115145.615259:0:15938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602655616 00000100:00100000:0.0:1787115145.615274:0:15938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 18 00000100:00100000:0.0:1787115145.615279:0:15938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+6:2361:x1873925602656000:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787115145.615299:0:15938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+6:2361:x1873925602656000:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 21us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115145.615305:0:15938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 18 00000100:00100000:0.0:1787115145.615313:0:15938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00100000:0.0:1787115145.615318:0:15938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+6:2361:x1873925602655616:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787115145.615334:0:15938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+6:2361:x1873925602655616:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 17us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115145.615340:0:15938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00080000:0.0:1787115145.615367:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787115145.615372:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787115145.615374:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787115145.618302:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602655488 00000100:00100000:2.0:1787115145.618315:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602655488 00000100:00100000:2.0:1787115145.618808:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 103 00000100:00100000:2.0:1787115145.618820:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af050303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+13:2361:x1873925602655488:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787115145.618916:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af050303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+13:2361:x1873925602655488:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 97us (4302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115145.618925:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 103 00010000:00010000:3.0:1787115145.735396:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787115146.764745:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787115146.990870:0:16175:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0a546bf0 20000000:00000080:0.0:1787115146.990886:0:16175:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8af05fa52c00 uarg=0000000000000000 20000000:01000000:0.0:1787115146.990924:0:16175:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787115146.990931:0:16175:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787115146.990935:0:16175:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787115146.992971:0:16176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1787115146.993264:0:16175:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787115147.004498:0:16175:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787115147.004535:0:16175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8af052364a00/0x194cd781e88c9740 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115147.004555:0:16175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af041682400/0x194cd781e88c9437 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c9430 expref: 18 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115147.004564:0:16175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af052365200/0x194cd781e88c9484 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c947d expref: 18 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115147.004571:0:16175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af08216e200/0x194cd781e88c95bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c95b8 expref: 18 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115147.004581:0:16175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aef418df600/0x194cd781e88c96de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d183e expref: 12 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115147.004589:0:16175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af07b6a0e00/0x194cd781e88c9716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18a0 expref: 12 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115147.004735:0:16175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8af052364a00/0x194cd781e88c9740 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115147.004786:0:16175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af07b6a0e00/0x194cd781e88c9716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18a0 expref: 12 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115147.004804:0:16175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af07b6a0e00/0x194cd781e88c9716 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18a0 expref: 12 pid: 14151 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115147.004841:0:16175:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb70000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16175:1873925624666112:192.168.202.10@tcp:104: 00010000:00010000:0.0:1787115147.005052:0:16175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aef418df600/0x194cd781e88c96de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d183e expref: 12 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115147.005060:0:16175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aef418df600/0x194cd781e88c96de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d183e expref: 12 pid: 14152 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115147.005069:0:16175:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb72d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16175:1873925624666240:192.168.202.10@tcp:104: 00010000:00010000:0.0:1787115147.005098:0:16175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af08216e200/0x194cd781e88c95bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c95b8 expref: 18 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115147.005241:0:16175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af08216e200/0x194cd781e88c95bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c95b8 expref: 18 pid: 14152 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115147.005252:0:16175:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb70e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16175:1873925624666368:0@lo:104: 00000100:00100000:0.0:1787115147.005295:0:16175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787115147.005344:0:16175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af052365200/0x194cd781e88c9484 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c947d expref: 18 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115147.005353:0:16175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af052365200/0x194cd781e88c9484 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c947d expref: 18 pid: 14151 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115147.005360:0:16175:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb71c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16175:1873925624666496:0@lo:104: 00000100:00100000:3.0:1787115147.005537:0:14142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624666368 00000100:00100000:3.0:1787115147.005546:0:14142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624666368 00000100:00100000:3.0:1787115147.005598:0:14142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787115147.005607:0:14142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137037ef-42b3-4c5c-b74a-b929b53d47b0+3:16175:x1873925624666368:12345-0@lo:104: 00010000:00010000:3.0:1787115147.005621:0:14142:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af041682a00/0x194cd781e88c95b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c95bf expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.005700:0:14142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787115147.005708:0:14142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137037ef-42b3-4c5c-b74a-b929b53d47b0+3:16175:x1873925624666368:12345-0@lo:104: Request processed in 101us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115147.005730:0:14142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787115147.005738:0:14146:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787115147.005746:0:14146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af041682a00/0x194cd781e88c95b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c95bf expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115147.005755:0:14146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af041682a00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:2.0:1787115147.005762:0:14146:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af041682a00/0x194cd781e88c95b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c95bf expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115147.005772:0:14146:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af041682a00/0x194cd781e88c95b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c95bf expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787115147.005780:0:14146:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af041682a00/0x194cd781e88c95b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c95bf expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787115147.005785:0:14146:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787115147.005979:0:14146:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af041682a00/0x194cd781e88c95b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c95bf expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.005989:0:14146:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787115147.006011:0:16175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787115147.006034:0:14146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af041682a00/0x194cd781e88c95b8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c95bf expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.006045:0:14146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af041682a00/0x194cd781e88c95b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c95bf expref: -99 pid: 15462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115147.006053:0:16175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af041682400/0x194cd781e88c9437 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x194cd781e88c9430 expref: 18 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.006059:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115147.006063:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787115147.006066:0:16175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af041682400/0x194cd781e88c9437 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x194cd781e88c9430 expref: 18 pid: 14152 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.006067:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787115147.006081:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137037ef-42b3-4c5c-b74a-b929b53d47b0:3308:1873925624666624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787115147.006086:0:16175:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb73800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16175:1873925624666752:0@lo:104: 00000100:00100000:0.0:1787115147.006151:0:16175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115147.006157:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115147.006255:0:16175:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af062021a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787115147.006278:0:16175:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb70e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16175:1873925624666368:0@lo:104: 00000100:00100000:2.0:1787115147.006338:0:14141:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787115147.006355:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624666496 00000100:00100000:2.0:1787115147.006358:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624666496 00000100:00100000:2.0:1787115147.006376:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624666752 00000100:00100000:2.0:1787115147.006379:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624666752 00000100:00100000:2.0:1787115147.006389:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787115147.006394:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137037ef-42b3-4c5c-b74a-b929b53d47b0+4:16175:x1873925624666496:12345-0@lo:104: 00010000:00010000:2.0:1787115147.006404:0:14141:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af042cb3a00/0x194cd781e88c947d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c9484 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115147.006454:0:14141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787115147.006465:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137037ef-42b3-4c5c-b74a-b929b53d47b0+4:16175:x1873925624666496:12345-0@lo:104: Request processed in 70us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115147.006472:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787115147.006484:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787115147.006489:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06e90d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137037ef-42b3-4c5c-b74a-b929b53d47b0+3:16175:x1873925624666752:12345-0@lo:104: 00010000:00010000:2.0:1787115147.006497:0:14141:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1200/0x194cd781e88c9430 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c9437 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115147.006583:0:16175:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb71c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16175:1873925624666496:0@lo:104: 00000100:00100000:3.0:1787115147.006592:0:14144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624666624 00000100:00100000:3.0:1787115147.006597:0:14144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624666624 00000100:00100000:0.0:1787115147.006606:0:16175:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb73800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16175:1873925624666752:0@lo:104: 00010000:00010000:3.0:1787115147.006615:0:14144:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af08216e200/0x194cd781e88c95bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c95b8 expref: 19 pid: 14152 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115147.006647:0:14144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787115147.006655:0:14144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:3308:x1873925624666624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787115147.006666:0:14144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787115147.006672:0:14144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af08216e200/0x194cd781e88c95bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c95b8 expref: 19 pid: 14152 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.006694:0:14144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af08216e200/0x194cd781e88c95bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c95b8 expref: 19 pid: 14152 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.006709:0:14144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af08216e200/0x194cd781e88c95bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c95b8 expref: 19 pid: 14152 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.006725:0:14144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787115147.006768:0:14144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:137037ef-42b3-4c5c-b74a-b929b53d47b0+18:3308:x1873925624666624:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115147.006780:0:14144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787115147.006829:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137037ef-42b3-4c5c-b74a-b929b53d47b0:3308:1873925624666624:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787115147.006830:0:14141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787115147.006841:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06e90d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137037ef-42b3-4c5c-b74a-b929b53d47b0+3:16175:x1873925624666752:12345-0@lo:104: Request processed in 350us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115147.006848:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787115147.006909:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787115147.006916:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af042cb3a00/0x194cd781e88c947d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c9484 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.006923:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3a00 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:3.0:1787115147.006927:0:14147:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af042cb3a00/0x194cd781e88c947d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c9484 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.006935:0:14147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af042cb3a00/0x194cd781e88c947d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c9484 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787115147.006942:0:14147:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af042cb3a00/0x194cd781e88c947d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c9484 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787115147.006948:0:14147:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787115147.006975:0:14147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af042cb3a00/0x194cd781e88c947d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c9484 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.006980:0:14147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787115147.006993:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af042cb3a00/0x194cd781e88c947d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c9484 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.007010:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af042cb3a00/0x194cd781e88c947d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c9484 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.007019:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787115147.007023:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1200/0x194cd781e88c9430 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x194cd781e88c9437 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.007039:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1200 already unused, calling callback (ffffffffc1adcc20) 10000000:00010000:3.0:1787115147.007042:0:14147:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1200/0x194cd781e88c9430 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x194cd781e88c9437 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.007049:0:14147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1200/0x194cd781e88c9430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x194cd781e88c9437 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787115147.007056:0:14147:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1200/0x194cd781e88c9430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x194cd781e88c9437 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787115147.007062:0:14147:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787115147.007077:0:14147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1200/0x194cd781e88c9430 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c9437 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.007083:0:14147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787115147.007098:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1200/0x194cd781e88c9430 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c9437 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.007126:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.110@tcp lock: ffff8af07b6a1200/0x194cd781e88c9430 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x194cd781e88c9437 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.007141:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115147.007142:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115147.007144:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787115147.007154:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137037ef-42b3-4c5c-b74a-b929b53d47b0:3306:1873925624667008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787115147.007180:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115147.007284:0:14143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624667008 00000100:00100000:3.0:1787115147.007289:0:14143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624667008 00010000:00010000:3.0:1787115147.007305:0:14143:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af041682400/0x194cd781e88c9437 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c9430 expref: 18 pid: 14152 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115147.007332:0:14143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787115147.007338:0:14143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137037ef-42b3-4c5c-b74a-b929b53d47b0+18:3306:x1873925624667008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787115147.007347:0:14143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787115147.007352:0:14143:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af041682400/0x194cd781e88c9437 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c9430 expref: 18 pid: 14152 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.007361:0:14143:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af041682400/0x194cd781e88c9437 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c9430 expref: 18 pid: 14152 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.007372:0:14143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af041682400/0x194cd781e88c9437 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c9430 expref: 18 pid: 14152 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.007382:0:14143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787115147.007408:0:14143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137037ef-42b3-4c5c-b74a-b929b53d47b0+17:3306:x1873925624667008:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115147.007414:0:14143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787115147.007431:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137037ef-42b3-4c5c-b74a-b929b53d47b0:3309:1873925624666880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787115147.007457:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115147.007483:0:14145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624666880 00000100:00100000:3.0:1787115147.007487:0:14145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624666880 00010000:00010000:3.0:1787115147.007499:0:14145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af052365200/0x194cd781e88c9484 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c947d expref: 17 pid: 14151 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115147.007516:0:14145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787115147.007521:0:14145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739b5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137037ef-42b3-4c5c-b74a-b929b53d47b0+17:3309:x1873925624666880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787115147.007528:0:14145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787115147.007532:0:14145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af052365200/0x194cd781e88c9484 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x194cd781e88c947d expref: 17 pid: 14151 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.007545:0:14145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af052365200/0x194cd781e88c9484 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x194cd781e88c947d expref: 17 pid: 14151 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.007555:0:14145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af052365200/0x194cd781e88c9484 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x194cd781e88c947d expref: 17 pid: 14151 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.007564:0:14145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787115147.007589:0:14145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739b5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:3309:x1873925624666880:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115147.007595:0:14145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787115147.007638:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137037ef-42b3-4c5c-b74a-b929b53d47b0:3309:1873925624666880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787115147.007654:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137037ef-42b3-4c5c-b74a-b929b53d47b0:3306:1873925624667008:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787115147.007800:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787115147.013637:0:16175:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb70000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16175:1873925624666112:192.168.202.10@tcp:104: 00000100:00100000:1.0:1787115147.013657:0:16175:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb72d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16175:1873925624666240:192.168.202.10@tcp:104: 00010000:00010000:1.0:1787115147.013709:0:16175:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8af052364a00/0x194cd781e88c9740 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115147.017882:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115147.017973:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115147.018042:0:14145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602656384 00000100:00100000:3.0:1787115147.018052:0:14145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602656384 00010000:00010000:3.0:1787115147.018093:0:14145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af07b6a0e00/0x194cd781e88c9716 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18a0 expref: 13 pid: 14151 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115147.018156:0:14145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602656512 00000100:00100000:3.0:1787115147.018160:0:14145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602656512 00010000:00010000:3.0:1787115147.018175:0:14145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aef418df600/0x194cd781e88c96de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d183e expref: 14 pid: 14152 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115147.018190:0:14145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:3.0:1787115147.018197:0:14145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5965936-b623-4bea-9c39-d92821f4f81e+14:2364:x1873925602656384:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787115147.018212:0:14145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787115147.018218:0:14145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8af07b6a0e00/0x194cd781e88c9716 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18a0 expref: 14 pid: 14151 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.018253:0:14145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af07b6a0e00/0x194cd781e88c9716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18a0 expref: 14 pid: 14151 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115147.018269:0:14143:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1787115147.018274:0:14145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af07b6a0e00/0x194cd781e88c9716 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18a0 expref: 14 pid: 14151 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115147.018282:0:14143:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1787115147.018295:0:14145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787115147.018350:0:14145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5965936-b623-4bea-9c39-d92821f4f81e+13:2364:x1873925602656384:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 152us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115147.018358:0:14145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:3.0:1787115147.018378:0:14145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:3.0:1787115147.018387:0:14145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5965936-b623-4bea-9c39-d92821f4f81e+12:2364:x1873925602656512:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787115147.018395:0:14145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787115147.018400:0:14145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8aef418df600/0x194cd781e88c96de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d183e expref: 12 pid: 14152 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.018412:0:14145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aef418df600/0x194cd781e88c96de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d183e expref: 12 pid: 14152 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.018422:0:14145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aef418df600/0x194cd781e88c96de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d183e expref: 12 pid: 14152 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.018434:0:14145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8af052364a00/0x194cd781e88c9740 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.018443:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af052364a00/0x194cd781e88c9740 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.018470:0:14145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af052364a00/0x194cd781e88c9740 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.018478:0:14145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af052364a00/0x194cd781e88c9740 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.018485:0:14145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8af052364a00/0x194cd781e88c9740 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.018491:0:14145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8af052364a00/0x194cd781e88c9740 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.018496:0:14145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364a00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:3.0:1787115147.018500:0:14145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8af052364a00/0x194cd781e88c9740 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.018509:0:14145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8af052364a00/0x194cd781e88c9740 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.018534:0:14145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8af052364a00/0x194cd781e88c9740 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.018545:0:14145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787115147.018562:0:14145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5965936-b623-4bea-9c39-d92821f4f81e+11:2364:x1873925602656512:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 178us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115147.018570:0:14145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8 00010000:00010000:0.0:1787115147.018582:0:16175:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8af052364a00/0x194cd781e88c9740 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115147.018602:0:16175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8af052364a00/0x194cd781e88c9740 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115147.018610:0:16175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af052364a00/0x194cd781e88c9740 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115147.781313:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787115148.409891:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115148.409961:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602656640 00000100:00100000:3.0:1787115148.409972:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602656640 00000100:00100000:3.0:1787115148.410034:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 104 00000100:00100000:3.0:1787115148.410059:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af050302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+11:13722:x1873925602656640:12345-192.168.202.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787115148.410077:0:14153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115148.410097:0:14153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aef418df200/0x194cd781e88c9747 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d18d1 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115148.410169:0:14153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aef418df200/0x194cd781e88c9747 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18d1 expref: 12 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115148.410181:0:14153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aef418df200/0x194cd781e88c9747 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18d1 expref: 12 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115148.410190:0:14153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aef418df200, rc 0) 00000100:00100000:3.0:1787115148.410251:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af050302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+12:13722:x1873925602656640:12345-192.168.202.10@tcp:101:ll_cfg_requeue.0 Request processed in 195us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115148.410259:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 104 00000100:00100000:1.0:1787115148.418020:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115148.418286:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602656768 00000100:00100000:3.0:1787115148.418297:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602656768 00000100:00100000:3.0:1787115148.418375:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 105 00000100:00100000:3.0:1787115148.418384:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+12:13722:x1873925602656768:12345-192.168.202.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787115148.418823:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+12:13722:x1873925602656768:12345-192.168.202.10@tcp:501:ll_cfg_requeue.0 Request processed in 438us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115148.418841:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 105 00000100:00100000:1.0:1787115148.421644:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115148.421745:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602656896 00000100:00100000:0.0:1787115148.421757:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602656896 00000100:00100000:0.0:1787115148.421853:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 106 00000100:00100000:0.0:1787115148.421872:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+12:13722:x1873925602656896:12345-192.168.202.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787115148.422163:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+12:13722:x1873925602656896:12345-192.168.202.10@tcp:503:ll_cfg_requeue.0 Request processed in 292us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115148.422173:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 106 00000100:00100000:0.0:1787115148.428649:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115148.428897:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602657024 00000100:00100000:2.0:1787115148.428910:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602657024 00000100:00100000:2.0:1787115148.428975:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 107 00000100:00100000:2.0:1787115148.428987:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+12:13722:x1873925602657024:12345-192.168.202.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787115148.429008:0:14151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115148.429028:0:14151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af08216e200/0x194cd781e88c974e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d18d8 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115148.429059:0:14151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af08216e200/0x194cd781e88c974e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18d8 expref: 13 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115148.429072:0:14151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af08216e200/0x194cd781e88c974e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18d8 expref: 13 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115148.429098:0:14151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216e200, rc 0) 00000100:00100000:2.0:1787115148.429247:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+13:13722:x1873925602657024:12345-192.168.202.10@tcp:101:ll_cfg_requeue.0 Request processed in 261us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115148.429254:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 107 00000100:00100000:1.0:1787115148.431644:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115148.431728:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602657152 00000100:00100000:0.0:1787115148.431738:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602657152 00000100:00100000:0.0:1787115148.431795:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 108 00000100:00100000:0.0:1787115148.431805:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+13:13722:x1873925602657152:12345-192.168.202.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787115148.432175:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+13:13722:x1873925602657152:12345-192.168.202.10@tcp:501:ll_cfg_requeue.0 Request processed in 359us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115148.432184:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 108 00000100:00100000:0.0:1787115148.440347:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115148.440403:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602657280 00000100:00100000:2.0:1787115148.440415:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602657280 00000100:00100000:2.0:1787115148.440490:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 109 00000100:00100000:2.0:1787115148.440501:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+13:13722:x1873925602657280:12345-192.168.202.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787115148.440946:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5965936-b623-4bea-9c39-d92821f4f81e+13:13722:x1873925602657280:12345-192.168.202.10@tcp:503:ll_cfg_requeue.0 Request processed in 445us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115148.440955:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 109 00000100:00100000:0.0:1787115148.677457:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624667520:0@lo:400:kworker.0 00000100:00100000:0.0:1787115148.677528:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115148.677586:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787115148.677593:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137037ef-42b3-4c5c-b74a-b929b53d47b0:3306:1873925624667136:0@lo:400:kworker.0 00000100:00100000:0.0:1787115148.677639:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115148.677664:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624667648:0@lo:400:kworker.0 00000100:00100000:0.0:1787115148.677701:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115148.677738:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624667264:0@lo:400:kworker.0 00000100:00100000:0.0:1787115148.677763:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115148.677780:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624667776:0@lo:400:kworker.0 00000100:00100000:0.0:1787115148.677799:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115148.677815:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787115148.677821:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624667392:0@lo:400:kworker.0 00000100:00100000:0.0:1787115148.677854:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115148.678164:0:15938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624667520 00000100:00100000:0.0:1787115148.678173:0:15938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624667520 00000100:00100000:0.0:1787115148.678297:0:15938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624667648 00000100:00100000:0.0:1787115148.678301:0:15938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624667648 00000100:00100000:0.0:1787115148.678325:0:15938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624667776 00000100:00100000:0.0:1787115148.678328:0:15938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624667776 00000100:00100000:0.0:1787115148.678345:0:15938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787115148.678353:0:15938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624667520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787115148.678408:0:15938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624667520:12345-0@lo:400:kworker.0 Request processed in 54us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115148.678416:0:15938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787115148.678431:0:15938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787115148.678437:0:15938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624667648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787115148.678463:0:15938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873925624667648:12345-0@lo:400:kworker.0 Request processed in 27us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115148.678469:0:15938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787115148.678479:0:15938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787115148.678485:0:15938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624667776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787115148.678515:0:15938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873925624667776:12345-0@lo:400:kworker.0 Request processed in 31us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115148.678521:0:15938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787115148.678539:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624667136 00000100:00100000:0.0:1787115148.678543:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624667136 00000100:00100000:0.0:1787115148.678569:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787115148.678576:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:3306:x1873925624667136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787115148.678605:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:3306:x1873925624667136:12345-0@lo:400:kworker.0 Request processed in 30us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115148.678611:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787115148.678650:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624667264 00000100:00100000:0.0:1787115148.678660:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624667264 00000100:00100000:0.0:1787115148.678884:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624667392 00000100:00100000:0.0:1787115148.678888:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624667392 00000100:00100000:0.0:1787115148.678910:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787115148.678917:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624667264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787115148.678949:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624667264:12345-0@lo:400:kworker.0 Request processed in 33us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115148.678955:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787115148.678966:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787115148.678971:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624667392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787115148.678996:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873925624667392:12345-0@lo:400:kworker.0 Request processed in 25us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115148.679001:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787115148.679061:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787115148.679065:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787115148.679068:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787115148.679090:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624667904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787115148.679575:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115148.679630:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624667904 00000100:00100000:0.0:1787115148.679633:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624667904 00000100:00100000:0.0:1787115148.679654:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787115148.679658:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624667904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787115148.679694:0:14797:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787115148.680021:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624667904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 361us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115148.680029:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787115148.680084:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624667392:0@lo:400:kworker.0 00000100:00100000:0.0:1787115148.680134:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873925624667264:0@lo:400:kworker.0 00000100:00100000:0.0:1787115148.680147:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873925624667776:0@lo:400:kworker.0 00000100:00100000:0.0:1787115148.680561:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137037ef-42b3-4c5c-b74a-b929b53d47b0:3306:1873925624667136:0@lo:400:kworker.0 00000100:00100000:0.0:1787115148.680591:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873925624667648:0@lo:400:kworker.0 00000100:00100000:0.0:1787115148.680845:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624667520:0@lo:400:kworker.0 00000100:00100000:1.0:1787115148.681893:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624667904:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787115148.806314:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787115148.933271:0:14155:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787115148.933279:0:14155:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af06f4bb000 from 10 10000000:01000000:0.0:1787115148.933285:0:14155:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787115148.933345:0:14155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c9755 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115148.933358:0:14155:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c9755 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115148.933369:0:14155:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c9755 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115148.933400:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624668032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787115148.933490:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115148.933553:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045b3fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787115148.933779:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624668032 00000100:00100000:2.0:1787115148.933786:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624668032 00000100:00100000:2.0:1787115148.933840:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787115148.933847:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+16:14155:x1873925624668032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787115148.933858:0:14151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115148.933870:0:14151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af08216f800/0x194cd781e88c975c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c9755 expref: -99 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115148.933890:0:14151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af08216f800/0x194cd781e88c975c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c9755 expref: 17 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115148.933899:0:14151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af08216f800/0x194cd781e88c975c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c9755 expref: 17 pid: 14151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115148.933922:0:14151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216f800, rc 0) 00000100:00100000:2.0:1787115148.933964:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+17:14155:x1873925624668032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115148.933975:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787115148.934234:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624668032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787115148.934249:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c9755 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c975c expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115148.934256:0:14155:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c9755 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c975c expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115148.934320:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624668160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787115148.934343:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115148.934384:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5fae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787115148.934456:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624668160 00000100:00100000:1.0:1787115148.934459:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624668160 00000100:00100000:1.0:1787115148.934475:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787115148.934480:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+17:14155:x1873925624668160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787115148.934824:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+17:14155:x1873925624668160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 341us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115148.934847:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787115148.935010:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624668160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787115148.935044:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624668288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787115148.935074:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115148.935197:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5fae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787115148.935267:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624668288 00000100:00100000:1.0:1787115148.935270:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624668288 00000100:00100000:2.0:1787115148.935334:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787115148.935341:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+17:14155:x1873925624668288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787115148.935473:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+17:14155:x1873925624668288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115148.935480:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787115148.935523:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624668288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787115148.936494:0:16286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787115148.936558:0:14155:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787115148.936585:0:14155:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787115148.936595:0:14155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c9755 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c975c expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115148.936604:0:14155:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af052365c00/0x194cd781e88c9755 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c975c expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787115148.936622:0:14155:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787115148.936625:0:14155:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af059005000 from 10 10000000:01000000:0.0:1787115148.936628:0:14155:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787115148.936660:0:14155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365800/0x194cd781e88c9763 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115148.936682:0:14155:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af052365800/0x194cd781e88c9763 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115148.936693:0:14155:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af052365800/0x194cd781e88c9763 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115148.936766:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624668416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787115148.936815:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115148.936853:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045b3fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787115148.936865:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624668416 00000100:00100000:1.0:1787115148.936872:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624668416 00000100:00100000:1.0:1787115148.936904:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787115148.936910:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+17:14155:x1873925624668416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787115148.936918:0:14153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115148.936928:0:14153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af07b6a1200/0x194cd781e88c976a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c9763 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115148.936943:0:14153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af07b6a1200/0x194cd781e88c976a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c9763 expref: 18 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115148.936950:0:14153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af07b6a1200/0x194cd781e88c976a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c9763 expref: 18 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115148.936955:0:14153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a1200, rc 0) 00000100:00100000:1.0:1787115148.936984:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+18:14155:x1873925624668416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115148.936990:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787115148.937017:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624668416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787115148.937029:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af052365800/0x194cd781e88c9763 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c976a expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115148.937037:0:14155:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af052365800/0x194cd781e88c9763 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c976a expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115148.937083:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624668544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787115148.937133:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115148.937156:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045b3fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787115148.937212:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624668544 00000100:00100000:2.0:1787115148.937217:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624668544 00000100:00100000:2.0:1787115148.937246:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787115148.937253:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+18:14155:x1873925624668544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787115148.937535:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+18:14155:x1873925624668544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 282us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115148.937541:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787115148.937594:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624668544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787115148.937619:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624668672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787115148.937657:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115148.937691:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045b3fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787115148.937694:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624668672 00000100:00100000:3.0:1787115148.937698:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624668672 00000100:00100000:3.0:1787115148.937769:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787115148.937776:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+18:14155:x1873925624668672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787115148.937901:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+18:14155:x1873925624668672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115148.937908:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787115148.937916:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624668672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787115148.940245:0:16287:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787115148.940479:0:14155:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787115148.940499:0:14155:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787115148.940510:0:14155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365800/0x194cd781e88c9763 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c976a expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115148.940522:0:14155:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af052365800/0x194cd781e88c9763 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c976a expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787115148.940534:0:14155:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787115148.940536:0:14155:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af07b587800 from 10 10000000:01000000:0.0:1787115148.940539:0:14155:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787115148.940577:0:14155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c9771 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115148.940586:0:14155:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c9771 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115148.940597:0:14155:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c9771 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115148.940622:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624668800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787115148.940707:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115148.940845:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045b3fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787115148.940891:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624668800 00000100:00100000:2.0:1787115148.940899:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624668800 00000100:00100000:2.0:1787115148.940953:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787115148.940962:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+18:14155:x1873925624668800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787115148.940976:0:14152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115148.940990:0:14152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af08216fa00/0x194cd781e88c9778 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x194cd781e88c9771 expref: -99 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115148.941045:0:14152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af08216fa00/0x194cd781e88c9778 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x194cd781e88c9771 expref: 19 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115148.941057:0:14152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af08216fa00/0x194cd781e88c9778 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x194cd781e88c9771 expref: 19 pid: 14152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115148.941066:0:14152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216fa00, rc 0) 00000100:00100000:2.0:1787115148.941265:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:14155:x1873925624668800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 303us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115148.941273:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787115148.941333:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624668800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787115148.941348:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c9771 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9778 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115148.941363:0:14155:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c9771 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x194cd781e88c9778 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115148.941411:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624668928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787115148.941437:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115148.941492:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045b3fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787115148.941502:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624668928 00000100:00100000:1.0:1787115148.941507:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624668928 00000100:00100000:1.0:1787115148.941527:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787115148.941534:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f53cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:14155:x1873925624668928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787115148.941813:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f53cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:14155:x1873925624668928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115148.942433:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624668928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787115148.942483:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624669056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787115148.942530:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115148.942561:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045b3fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787115148.942953:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624669056 00000100:00100000:2.0:1787115148.942959:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624669056 00000100:00100000:2.0:1787115148.942987:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787115148.942994:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af047e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+20:14155:x1873925624669056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787115148.943178:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af047e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137037ef-42b3-4c5c-b74a-b929b53d47b0+20:14155:x1873925624669056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115148.943235:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787115148.943279:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137037ef-42b3-4c5c-b74a-b929b53d47b0:14155:1873925624669056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787115148.943891:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000040:00080000:0.0:1787115148.945061:0:16288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787115148.945747:0:14155:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787115148.945781:0:14155:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787115148.945794:0:14155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c9771 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9778 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115148.945807:0:14155:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.110@tcp lock: ffff8af052365400/0x194cd781e88c9771 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x194cd781e88c9778 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115149.590208:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115149.590273:0:15938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602657408 00000100:00100000:1.0:1787115149.590283:0:15938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602657408 00000100:00100000:1.0:1787115149.590349:0:15938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15 00000100:00100000:1.0:1787115149.590357:0:15938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+6:14376:x1873925602657408:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787115149.590374:0:15938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115149.590394:0:15938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c977f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d18df expref: -99 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.590456:0:15938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9786 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.590467:0:15938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9786 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.590476:0:15938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9786 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.590485:0:15938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c978d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.590490:0:15938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c978d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.590508:0:15938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c978d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.590936:0:15938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c9794 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.590945:0:15938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c9794 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.590953:0:15938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c9794 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787115149.591036:0:15938:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787115149.591041:0:15938:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787115149.591186:0:15938:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c9794 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.591198:0:15938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9786 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.591205:0:15938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9786 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.591211:0:15938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9786 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.591216:0:15938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a1000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115149.591220:0:15938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9786 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.591228:0:15938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9786 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.591246:0:15938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0510d6e00) 00010000:00010000:1.0:1787115149.591249:0:15938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787115149.591254:0:15938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9786 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.591261:0:15938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9786 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.591274:0:15938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c978d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.591280:0:15938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c978d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.591285:0:15938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c978d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.591290:0:15938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:1.0:1787115149.591293:0:15938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c978d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.591299:0:15938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c978d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.591306:0:15938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8af0510d6900) 00010000:00010000:1.0:1787115149.591309:0:15938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787115149.591312:0:15938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c978d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.591319:0:15938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0200/0x194cd781e88c978d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.591362:0:15938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1a00/0x194cd781e88c977f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18df expref: 8 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.591376:0:15938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0e00/0x194cd781e88c9794 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18df expref: 7 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.591384:0:15938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8af0510d6f00) 00010000:00010000:1.0:1787115149.591386:0:15938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787115149.591389:0:15938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a0e00, rc 0) 00000100:00100000:1.0:1787115149.591446:0:15938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+7:14376:x1873925602657408:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 1089us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115149.591454:0:15938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15 00000100:00080000:2.0:1787115149.591952:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787115149.607374:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115149.607466:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602657664 00000100:00100000:0.0:1787115149.607475:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602657664 00000100:00100000:0.0:1787115149.607611:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16 00000100:00100000:0.0:1787115149.607619:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+7:14376:x1873925602657664:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787115149.607638:0:14159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115149.607671:0:14159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c979b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d18e6 expref: -99 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.607915:0:14159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364200/0x194cd781e88c97a2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.607934:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364200/0x194cd781e88c97a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.607963:0:14159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364200/0x194cd781e88c97a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.607994:0:14159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c97a9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.608001:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c97a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.608007:0:14159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c97a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.608463:0:14159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365e00/0x194cd781e88c97b0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.608469:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365e00/0x194cd781e88c97b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.608474:0:14159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365e00/0x194cd781e88c97b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115149.608482:0:14159:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787115149.608894:0:14159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364200/0x194cd781e88c97a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.608900:0:14159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364200/0x194cd781e88c97a2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.608905:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364200/0x194cd781e88c97a2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.608909:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115149.608916:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364200/0x194cd781e88c97a2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.608921:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364200/0x194cd781e88c97a2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.608931:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8af0510d6f00) 00010000:00010000:0.0:1787115149.608933:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115149.608935:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364200/0x194cd781e88c97a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.608939:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364200/0x194cd781e88c97a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.608948:0:14159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c97a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.608952:0:14159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c97a9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.608956:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c97a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.608958:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364800 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115149.608960:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c97a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.608963:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c97a9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.608967:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8af051ecb000) 00010000:00010000:0.0:1787115149.608968:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115149.608973:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c97a9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.608977:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c97a9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.609316:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c979b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18e6 expref: 10 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.609331:0:14159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365e00/0x194cd781e88c97b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18e6 expref: 9 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.609339:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8af051ecb200) 00010000:00010000:0.0:1787115149.609342:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115149.609345:0:14159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052365e00, rc 0) 00000100:00100000:0.0:1787115149.609439:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+9:14376:x1873925602657664:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 1821us (2073us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787115149.609446:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16 00000100:00100000:0.0:1787115149.618016:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115149.618093:0:15938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602657792 00000100:00100000:1.0:1787115149.618139:0:15938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602657792 00000100:00100000:1.0:1787115149.618193:0:15938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17 00000100:00100000:1.0:1787115149.618308:0:15938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+9:14376:x1873925602657792:12345-192.168.202.10@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787115149.618405:0:15938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+9:14376:x1873925602657792:12345-192.168.202.10@tcp:59:lhsmtool_posix.0 Request processed in 204us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115149.618413:0:15938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17 00000100:00100000:2.0:1787115149.641836:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115149.642058:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602657920 00000100:00100000:0.0:1787115149.642068:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602657920 00000100:00100000:2.0:1787115149.642217:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 18 00000100:00100000:2.0:1787115149.642230:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+9:14382:x1873925602657920:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1787115149.642252:0:14159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115149.642277:0:14159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c97be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d18ed expref: -99 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.642367:0:14159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c97c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.642382:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c97c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.642394:0:14159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c97c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.642409:0:14159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c97cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.642496:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c97cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.642505:0:14159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c97cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.642759:0:14159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c97c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.642768:0:14159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c97c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.642775:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c97c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.642782:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115149.642786:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c97c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.642802:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c97c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.642815:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0510d6e00) 00010000:00010000:2.0:1787115149.642818:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115149.642822:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c97c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.642829:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c97c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.642841:0:14159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c97cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.642847:0:14159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c97cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.642853:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c97cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.642859:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115149.642862:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c97cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.642867:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c97cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.642874:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8af0514c6800) 00010000:00010000:2.0:1787115149.642876:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115149.642878:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c97cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.643099:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c97cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.643178:0:14159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c97be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18ed expref: 10 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.643191:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0510d6e00) 00010000:00010000:2.0:1787115149.643193:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115149.643197:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af08216e600/0x194cd781e88c97be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18ed expref: 10 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.643209:0:14159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af08216e600, rc 0) 00000100:00100000:2.0:1787115149.643276:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+9:14382:x1873925602657920:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 1044us (1444us total) trans 0 rc 301/301 00000100:00100000:2.0:1787115149.643284:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 18 00000100:00100000:2.0:1787115149.646838:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115149.646957:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602658048 00000100:00100000:3.0:1787115149.646969:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602658048 00000100:00100000:3.0:1787115149.647030:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:3.0:1787115149.647040:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:278330ce-de2f-4eb0-ab55-65b736a927fb+9:14382:x1873925602658048:12345-192.168.202.10@tcp:700:lfs.0 00000100:00100000:3.0:1787115149.647178:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:278330ce-de2f-4eb0-ab55-65b736a927fb+9:14382:x1873925602658048:12345-192.168.202.10@tcp:700:lfs.0 Request processed in 137us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115149.647186:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:0.0:1787115149.654534:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115149.654621:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602658304 00000100:00100000:3.0:1787115149.654632:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602658304 00000100:00100000:3.0:1787115149.654707:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00100000:3.0:1787115149.654718:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+9:14382:x1873925602658304:12345-192.168.202.10@tcp:36:lfs.0 00010000:00010000:3.0:1787115149.654777:0:14157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787115149.654802:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a0600/0x194cd781e88c9701 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1868 expref: 9 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.654822:0:14157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0510d6e00) 00010000:00010000:3.0:1787115149.654827:0:14157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787115149.655085:0:14157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c97d3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.655099:0:14157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c9739 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18ca expref: 5 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.655155:0:14157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c97d3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.655188:0:14157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c9739 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18ca expref: 5 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.655202:0:14157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c9739 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18ca expref: 5 pid: 14157 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115149.655227:0:14157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f4c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14157:1873925624669184:192.168.202.10@tcp:104: 00000100:00100000:3.0:1787115149.655309:0:14157:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5fae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787115149.658612:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115149.658716:0:14143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602658432 00000100:00100000:1.0:1787115149.658725:0:14143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602658432 00010000:00010000:1.0:1787115149.658783:0:14143:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c9739 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18ca expref: 6 pid: 14157 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115149.658825:0:14143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00100000:1.0:1787115149.658835:0:14143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+6:2364:x1873925602658432:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787115149.658864:0:14143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787115149.658872:0:14143:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c9739 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18ca expref: 6 pid: 14157 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.658885:0:14143:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c9739 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18ca expref: 6 pid: 14157 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.658918:0:14143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0510d6e00) 00010000:00010000:1.0:1787115149.658924:0:14143:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c97d3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.658933:0:14143:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c97d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.658941:0:14143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c97d3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.658959:0:14143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787115149.659016:0:14143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+6:2364:x1873925602658432:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 181us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115149.659024:0:14143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00080000:2.0:1787115149.659336:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787115149.659551:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c9739 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18ca expref: 5 pid: 14157 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115149.659576:0:14157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f4c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14157:1873925624669184:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787115149.659599:0:14157:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c97d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.659608:0:14157:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c97d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.659615:0:14157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c97d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.659638:0:14157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418dfe00/0x194cd781e88c97da lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.659647:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418dfe00/0x194cd781e88c97da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.659656:0:14157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418dfe00/0x194cd781e88c97da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787115149.661696:0:14157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787115149.661715:0:14157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c97d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.661726:0:14157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c97d3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.661735:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c97d3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.661741:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aef418df600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115149.661752:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c97d3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.661761:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c97d3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.661775:0:14157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af0510d6e00) 00010000:00010000:3.0:1787115149.661779:0:14157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115149.661783:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c97d3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.661789:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c97d3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787115149.661808:0:14157:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f80e938a reply state 0000000019c81f8c transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418dfe00/0x194cd781e88c97da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115149.661817:0:14157:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787115149.662004:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+10:14382:x1873925602658304:12345-192.168.202.10@tcp:36:lfs.0 Request processed in 7285us (7476us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787115149.662014:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 19 00010000:00010000:2.0:1787115149.666168:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418dfe00/0x194cd781e88c97da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.666188:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418dfe00/0x194cd781e88c97da lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.666196:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418dfe00/0x194cd781e88c97da lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.666202:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aef418dfe00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115149.666207:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418dfe00/0x194cd781e88c97da lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.666240:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418dfe00/0x194cd781e88c97da lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.666257:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8af0821c0000) 00010000:00010000:2.0:1787115149.666261:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115149.666266:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418dfe00/0x194cd781e88c97da lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.666273:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418dfe00/0x194cd781e88c97da lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115149.812720:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115149.812983:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602658560 00000100:00100000:0.0:1787115149.812995:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602658560 00000100:00100000:0.0:1787115149.813069:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 20 00000100:00100000:0.0:1787115149.813080:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+9:14390:x1873925602658560:12345-192.168.202.10@tcp:101:lctl.0 00010000:00010000:0.0:1787115149.813139:0:14158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115149.813164:0:14158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c97e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d18f4 expref: -99 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.813625:0:14158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c97e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.813641:0:14158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c97e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.813653:0:14158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c97e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115149.813741:0:14158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787115149.813746:0:14158:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787115149.813801:0:14158:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c97e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.814318:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c97e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18f4 expref: 11 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.814343:0:14158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364a00/0x194cd781e88c97e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18f4 expref: 10 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.814353:0:14158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af051ecb000) 00010000:00010000:0.0:1787115149.814356:0:14158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787115149.814360:0:14158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af052364a00, rc 0) 00000100:00100000:0.0:1787115149.817716:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+10:14390:x1873925602658560:12345-192.168.202.10@tcp:101:lctl.0 Request processed in 4622us (4991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115149.817731:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 20 00010000:00010000:3.0:1787115149.829981:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787115149.856335:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115149.856554:0:15938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602658688 00000100:00100000:1.0:1787115149.856564:0:15938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602658688 00000100:00100000:1.0:1787115149.856624:0:15938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 21 00000100:00100000:1.0:1787115149.856636:0:15938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+5:14391:x1873925602658688:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1787115149.856668:0:15938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115149.856693:0:15938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c97ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d18fb expref: -99 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.856786:0:15938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c97f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.856802:0:15938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c97f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.856816:0:15938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c97f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787115149.856884:0:15938:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787115149.856905:0:15938:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787115149.856939:0:15938:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c97f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.856966:0:15938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c97ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18fb expref: 7 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.856985:0:15938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1400/0x194cd781e88c97f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d18fb expref: 6 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.856993:0:15938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af051ecb000) 00010000:00010000:1.0:1787115149.856996:0:15938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787115149.857000:0:15938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a1400, rc 0) 00000100:00100000:1.0:1787115149.857081:0:15938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+6:14391:x1873925602658688:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 448us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115149.857088:0:15938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 21 00000100:00100000:2.0:1787115149.864867:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115149.865042:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602658816 00000100:00100000:0.0:1787115149.865069:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602658816 00000100:00100000:0.0:1787115149.865176:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 22 00000100:00100000:0.0:1787115149.865189:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+6:14391:x1873925602658816:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1787115149.865227:0:14159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115149.865255:0:14159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365200/0x194cd781e88c97fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1902 expref: -99 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865342:0:14159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c9804 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865358:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c9804 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865372:0:14159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c9804 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865388:0:14159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364200/0x194cd781e88c980b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865396:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364200/0x194cd781e88c980b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865402:0:14159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364200/0x194cd781e88c980b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865569:0:14159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c9812 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865578:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c9812 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865585:0:14159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c9812 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115149.865635:0:14159:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787115149.865639:0:14159:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787115149.865677:0:14159:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c9812 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865691:0:14159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c9804 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865698:0:14159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c9804 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865705:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c9804 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865711:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364800 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115149.865716:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c9804 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865723:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c9804 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865737:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af051ecb000) 00010000:00010000:0.0:1787115149.865741:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115149.865747:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c9804 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865752:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364800/0x194cd781e88c9804 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865768:0:14159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364200/0x194cd781e88c980b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865785:0:14159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364200/0x194cd781e88c980b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865791:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364200/0x194cd781e88c980b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865796:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af052364200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115149.865799:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364200/0x194cd781e88c980b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865806:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364200/0x194cd781e88c980b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865813:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8af051ecb800) 00010000:00010000:0.0:1787115149.865816:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115149.865819:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364200/0x194cd781e88c980b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865825:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052364200/0x194cd781e88c980b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865855:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af052365200/0x194cd781e88c97fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1902 expref: 8 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865868:0:14159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c9812 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1902 expref: 7 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.865874:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8af051ecb100) 00010000:00010000:0.0:1787115149.865877:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787115149.865884:0:14159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3a00, rc 0) 00000100:00100000:0.0:1787115149.866186:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+7:14391:x1873925602658816:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 998us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115149.866195:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 22 00000100:00100000:0.0:1787115149.875419:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115149.875991:0:15938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602659072 00000100:00100000:1.0:1787115149.876003:0:15938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602659072 00000100:00100000:1.0:1787115149.876077:0:15938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 23 00000100:00100000:1.0:1787115149.876087:0:15938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+7:14391:x1873925602659072:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:1.0:1787115149.876145:0:15938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787115149.876172:0:15938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9819 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1909 expref: -99 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787115149.876295:0:15938:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787115149.876428:0:15938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9819 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1909 expref: 9 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.876454:0:15938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af051ecb000) 00010000:00010000:1.0:1787115149.876457:0:15938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787115149.876462:0:15938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af07b6a1000/0x194cd781e88c9819 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1909 expref: 9 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115149.876479:0:15938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af07b6a1000, rc 0) 00000100:00100000:1.0:1787115149.876559:0:15938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+8:14391:x1873925602659072:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 473us (1148us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1787115149.876567:0:15938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 23 00000100:00100000:3.0:1787115149.881649:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115149.881815:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602659328 00000100:00100000:0.0:1787115149.881835:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602659328 00000100:00100000:0.0:1787115149.881901:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 24 00000100:00100000:0.0:1787115149.881911:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+8:14391:x1873925602659328:12345-192.168.202.10@tcp:36:lfs.0 00010000:00010000:0.0:1787115149.881966:0:14159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787115149.881994:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c9812 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1902 expref: 8 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.882015:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8af051ecb100) 00010000:00010000:0.0:1787115149.882026:0:14159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787115149.882047:0:14159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c9827 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.882060:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c9827 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.882069:0:14159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c9827 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787115149.882355:0:14159:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000019d0cbeb reply state 00000000e4f56e29 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c9827 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115149.882367:0:14159:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787115149.882379:0:14159:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1787115149.882791:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+9:14391:x1873925602659328:12345-192.168.202.10@tcp:36:lfs.0 Request processed in 880us (1150us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787115149.882813:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 24 00000100:00100000:2.0:1787115149.887076:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115149.887676:0:14160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602659584 00000100:00100000:0.0:1787115149.887688:0:14160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602659584 00000100:00100000:0.0:1787115149.887759:0:14160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 2 00000100:00100000:0.0:1787115149.887772:0:14160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+9:14391:x1873925602659584:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:0.0:1787115149.888098:0:14160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+10:14391:x1873925602659584:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 328us (1031us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787115149.888128:0:14160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 2 00010000:00010000:3.0:1787115149.890749:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c9827 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.890770:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c9827 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.890777:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c9827 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.890805:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115149.890810:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c9827 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.890830:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c9827 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.890851:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8af051ecb800) 00010000:00010000:3.0:1787115149.890854:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787115149.890859:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c9827 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115149.890866:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3000/0x194cd781e88c9827 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115149.891755:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115149.891833:0:15938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602659840 00000100:00100000:0.0:1787115149.891843:0:15938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602659840 00000100:00100000:0.0:1787115149.891895:0:15938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 25 00000100:00100000:0.0:1787115149.891904:0:15938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+9:14391:x1873925602659840:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1787115149.891929:0:15938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115149.891946:0:15938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2600/0x194cd781e88c982e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1910 expref: -99 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892018:0:15938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c9835 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892030:0:15938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c9835 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892041:0:15938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c9835 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892054:0:15938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c983c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892075:0:15938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c983c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892082:0:15938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c983c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115149.892253:0:15938:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787115149.892484:0:15938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c9835 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892493:0:15938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c9835 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892500:0:15938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c9835 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892507:0:15938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3800 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115149.892511:0:15938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c9835 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892518:0:15938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c9835 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892528:0:15938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af051ecb000) 00010000:00010000:0.0:1787115149.892531:0:15938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115149.892535:0:15938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c9835 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892541:0:15938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c9835 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892564:0:15938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c983c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892570:0:15938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c983c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892576:0:15938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c983c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892581:0:15938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115149.892584:0:15938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c983c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892589:0:15938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c983c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892596:0:15938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8af051ecbb00) 00010000:00010000:0.0:1787115149.892598:0:15938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115149.892600:0:15938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c983c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892606:0:15938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c983c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892640:0:15938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2600/0x194cd781e88c982e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1910 expref: 11 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892650:0:15938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af051ecb000) 00010000:00010000:0.0:1787115149.892652:0:15938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787115149.892673:0:15938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2600/0x194cd781e88c982e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1910 expref: 11 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.892683:0:15938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2600, rc 0) 00000100:00100000:0.0:1787115149.892746:0:15938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+10:14391:x1873925602659840:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 843us (997us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787115149.892754:0:15938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 25 00000100:00100000:1.0:1787115149.896042:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115149.896303:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602659968 00000100:00100000:2.0:1787115149.896325:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602659968 00000100:00100000:2.0:1787115149.896386:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 26 00000100:00100000:2.0:1787115149.896395:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+10:14391:x1873925602659968:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:2.0:1787115149.896422:0:14158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115149.896458:0:14158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c984a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1917 expref: -99 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.896568:0:14158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9851 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.896582:0:14158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9851 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.896593:0:14158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9851 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115149.896673:0:14158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787115149.896677:0:14158:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787115149.896704:0:14158:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9851 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.896728:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c984a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1917 expref: 12 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.896746:0:14158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9851 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1917 expref: 11 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.896756:0:14158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8af0514c6800) 00010000:00010000:2.0:1787115149.896758:0:14158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787115149.896762:0:14158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040031000, rc 0) 00000100:00100000:2.0:1787115149.897044:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+11:14391:x1873925602659968:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 648us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115149.897052:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 26 00000100:00100000:2.0:1787115149.901549:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115149.901632:0:14160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602660096 00000100:00100000:0.0:1787115149.901642:0:14160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602660096 00000100:00100000:0.0:1787115149.901712:0:14160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 3 00000100:00100000:0.0:1787115149.901722:0:14160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+11:14391:x1873925602660096:12345-192.168.202.10@tcp:37:lfs.0 00000100:00100000:0.0:1787115149.906995:0:14160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+11:14391:x1873925602660096:12345-192.168.202.10@tcp:37:lfs.0 Request processed in 5262us (5445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115149.907012:0:14160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 3 00000100:00100000:0.0:1787115149.910769:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115149.910900:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602660352 00000100:00100000:2.0:1787115149.910911:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602660352 00000100:00100000:2.0:1787115149.911000:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4 00000100:00100000:2.0:1787115149.911012:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07354f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+11:14391:x1873925602660352:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:2.0:1787115149.911303:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07354f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+12:14391:x1873925602660352:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 293us (542us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787115149.911319:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4 00000100:00100000:2.0:1787115149.978234:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115149.978350:0:15938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602660480 00000100:00100000:0.0:1787115149.978360:0:15938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602660480 00000100:00100000:0.0:1787115149.978425:0:15938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 27 00000100:00100000:0.0:1787115149.978443:0:15938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+10:14397:x1873925602660480:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:0.0:1787115149.978466:0:15938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115149.978490:0:15938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2600/0x194cd781e88c9858 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d191e expref: -99 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.978561:0:15938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c985f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.978576:0:15938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c985f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.978598:0:15938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c985f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.978614:0:15938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c9866 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.978622:0:15938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c9866 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.978628:0:15938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c9866 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.978760:0:15938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c986d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.978769:0:15938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c986d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.978776:0:15938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c986d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115149.978809:0:15938:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787115149.978813:0:15938:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787115149.978871:0:15938:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c986d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.978886:0:15938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c985f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.978893:0:15938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c985f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.978908:0:15938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c985f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.978915:0:15938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115149.978919:0:15938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c985f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.978928:0:15938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c985f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.978941:0:15938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af051ecb000) 00010000:00010000:0.0:1787115149.978945:0:15938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115149.978949:0:15938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c985f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.978956:0:15938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c985f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.978973:0:15938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c9866 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.978979:0:15938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c9866 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.978985:0:15938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c9866 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.978990:0:15938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3800 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115149.978992:0:15938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c9866 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.979005:0:15938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c9866 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.979013:0:15938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8af051ecbb00) 00010000:00010000:0.0:1787115149.979015:0:15938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115149.979018:0:15938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c9866 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.979023:0:15938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c9866 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.979051:0:15938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2600/0x194cd781e88c9858 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d191e expref: 12 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.979064:0:15938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3a00/0x194cd781e88c986d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d191e expref: 11 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.979072:0:15938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8af0514c6800) 00010000:00010000:0.0:1787115149.979075:0:15938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787115149.979077:0:15938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3a00, rc 0) 00000100:00100000:0.0:1787115149.979199:0:15938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+11:14397:x1873925602660480:12345-192.168.202.10@tcp:101:bash.0 Request processed in 757us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115149.979207:0:15938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 27 00000100:00100000:3.0:1787115149.983306:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115149.983524:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602660736 00000100:00100000:0.0:1787115149.983534:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602660736 00000100:00100000:0.0:1787115149.983590:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 28 00000100:00100000:0.0:1787115149.983599:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+11:14397:x1873925602660736:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:0.0:1787115149.983630:0:14159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115149.983649:0:14159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2600/0x194cd781e88c9874 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1925 expref: -99 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.983788:0:14159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c987b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.983804:0:14159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9851 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1917 expref: 11 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.983812:0:14159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c987b lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.983857:0:14159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9851 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1917 expref: 11 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.983871:0:14159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9851 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1917 expref: 11 pid: 14158 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115149.983885:0:14159:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb73800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14159:1873925624669312:192.168.202.10@tcp:104: 00000100:00100000:0.0:1787115149.983970:0:14159:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0510519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787115149.985967:0:14159:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb73800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14159:1873925624669312:192.168.202.10@tcp:104: 00010000:00010000:0.0:1787115149.985993:0:14159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c987b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115149.987099:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115149.987471:0:14145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602660864 00000100:00100000:0.0:1787115149.987480:0:14145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602660864 00010000:00010000:0.0:1787115149.987520:0:14145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9851 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1917 expref: 12 pid: 14158 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115149.987566:0:14145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 10 00000100:00100000:0.0:1787115149.987576:0:14145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+12:2363:x1873925602660864:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787115149.987594:0:14145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787115149.987602:0:14145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9851 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1917 expref: 12 pid: 14158 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.987615:0:14145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9851 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1917 expref: 12 pid: 14158 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.987640:0:14145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9851 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1917 expref: 12 pid: 14158 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.987674:0:14145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8af0514c6800) 00010000:00010000:0.0:1787115149.987680:0:14145:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c987b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.987692:0:14145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c987b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.987701:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c987b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.987736:0:14145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787115149.987794:0:14145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+11:2363:x1873925602660864:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 219us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115149.987804:0:14145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 10 00010000:00010000:2.0:1787115149.988033:0:14159:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c987b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.988041:0:14159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c987b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.988068:0:14159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9882 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.988079:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9882 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.988088:0:14159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9882 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.988839:0:14159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9889 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.988848:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9889 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.988857:0:14159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9889 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115149.988866:0:14159:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787115149.988891:0:14159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c987b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.988898:0:14159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c987b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.988905:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c987b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.988921:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3800 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115149.988926:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c987b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.988933:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c987b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.988944:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8af0514c6800) 00010000:00010000:2.0:1787115149.988946:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115149.988950:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c987b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.988956:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3800/0x194cd781e88c987b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787115149.988968:0:14159:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b8113baf reply state 00000000cbbd1ef4 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9882 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115149.988976:0:14159:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787115149.989006:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2600/0x194cd781e88c9874 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1925 expref: 14 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.989020:0:14159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9889 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1925 expref: 13 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115149.989028:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:2.0:1787115149.989030:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787115149.989033:0:14159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030a00, rc 0) 00000100:00100000:2.0:1787115149.989069:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+14:14397:x1873925602660736:12345-192.168.202.10@tcp:101:bash.0 Request processed in 5471us (5772us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787115149.989081:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 28 00010000:00010000:0.0:1787115149.992952:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9882 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.992979:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9882 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.992987:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9882 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.992994:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040031600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115149.992999:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9882 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.993007:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9882 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.993023:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8af0514c6400) 00010000:00010000:0.0:1787115149.993027:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115149.993031:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9882 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115149.993037:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9882 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115149.999947:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115150.000043:0:15938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602660992 00000100:00100000:0.0:1787115150.000053:0:15938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602660992 00000100:00100000:0.0:1787115150.000135:0:15938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 29 00000100:00100000:0.0:1787115150.000145:0:15938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+13:14397:x1873925602660992:12345-192.168.202.10@tcp:101:bash.0 00010000:00010000:0.0:1787115150.000174:0:15938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115150.000194:0:15938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c9897 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d192c expref: -99 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.000272:0:15938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c989e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.000287:0:15938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c989e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.000298:0:15938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c989e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115150.000333:0:15938:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787115150.000337:0:15938:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787115150.000355:0:15938:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c989e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.000367:0:15938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c989e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.000394:0:15938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c9897 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d192c expref: 15 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.000413:0:15938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c989e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d192c expref: 14 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.000422:0:15938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:0.0:1787115150.000425:0:15938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787115150.000428:0:15938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3e00, rc 0) 00000100:00100000:0.0:1787115150.000503:0:15938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+14:14397:x1873925602660992:12345-192.168.202.10@tcp:101:bash.0 Request processed in 359us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115150.000510:0:15938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 29 00000100:00100000:2.0:1787115150.003609:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115150.003718:0:14160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602661248 00000100:00100000:0.0:1787115150.003728:0:14160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602661248 00000100:00100000:0.0:1787115150.003787:0:14160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5 00000100:00100000:0.0:1787115150.003795:0:14160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+14:14397:x1873925602661248:12345-192.168.202.10@tcp:35:bash.0 00000100:00100000:0.0:1787115150.004332:0:14160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+15:14397:x1873925602661248:12345-192.168.202.10@tcp:35:bash.0 Request processed in 536us (730us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787115150.004340:0:14160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5 00000100:00100000:2.0:1787115150.086944:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115150.087145:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602661504 00000100:00100000:0.0:1787115150.087155:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602661504 00000100:00100000:0.0:1787115150.087217:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 30 00000100:00100000:0.0:1787115150.087227:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+15:14407:x1873925602661504:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1787115150.087250:0:14158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115150.087270:0:14158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c98a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1933 expref: -99 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115150.087375:0:14158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787115150.087497:0:14158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c98a5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1933 expref: 17 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.087512:0:14158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af051ecb000) 00010000:00010000:0.0:1787115150.087515:0:14158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787115150.087520:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c98a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1933 expref: 17 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.087534:0:14158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb2000, rc 0) 00000100:00100000:0.0:1787115150.087753:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+16:14407:x1873925602661504:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 526us (817us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787115150.087777:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 30 00000100:00100000:2.0:1787115150.090197:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115150.090260:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602661760 00000100:00100000:1.0:1787115150.090269:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602661760 00000100:00100000:1.0:1787115150.090312:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00100000:1.0:1787115150.090320:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+16:14407:x1873925602661760:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:1.0:1787115150.091345:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+17:14407:x1873925602661760:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 1021us (1153us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787115150.091370:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00100000:2.0:1787115150.128353:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115150.128453:0:15938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602662016 00000100:00100000:0.0:1787115150.128462:0:15938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602662016 00000100:00100000:0.0:1787115150.128520:0:15938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 31 00000100:00100000:0.0:1787115150.128529:0:15938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+17:14410:x1873925602662016:12345-192.168.202.10@tcp:101:lfs.0 00010000:00010000:0.0:1787115150.128554:0:15938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115150.128574:0:15938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c98b3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d193a expref: -99 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.128690:0:15938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3200/0x194cd781e88c98ba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.128703:0:15938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3200/0x194cd781e88c98ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.128716:0:15938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3200/0x194cd781e88c98ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115150.128728:0:15938:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787115150.128989:0:15938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c98b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d193a expref: 20 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.129011:0:15938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3200/0x194cd781e88c98ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d193a expref: 19 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.129020:0:15938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:0.0:1787115150.129023:0:15938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787115150.129027:0:15938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3200, rc 0) 00000100:00100000:0.0:1787115150.129099:0:15938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+19:14410:x1873925602662016:12345-192.168.202.10@tcp:101:lfs.0 Request processed in 571us (754us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787115150.129147:0:15938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 31 00000100:00100000:3.0:1787115150.134176:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115150.134258:0:14143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602662144 00000100:00100000:1.0:1787115150.134268:0:14143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602662144 00000100:00100000:1.0:1787115150.134331:0:14143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:1.0:1787115150.134341:0:14143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+19:2364:x1873925602662144:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787115150.134356:0:14143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787115150.134378:0:14143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3200/0x194cd781e88c98ba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d193a expref: 19 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115150.134395:0:14143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:1.0:1787115150.134399:0:14143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787115150.134453:0:14143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+18:2364:x1873925602662144:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 114us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115150.134460:0:14143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:2.0:1787115150.136497:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115150.136573:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602662272 00000100:00100000:0.0:1787115150.136581:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602662272 00000100:00100000:0.0:1787115150.136625:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 32 00000100:00100000:0.0:1787115150.136634:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+18:14410:x1873925602662272:12345-192.168.202.10@tcp:54:lfs.0 00010000:00010000:0.0:1787115150.136705:0:14159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c98c8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.136720:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c98c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.136731:0:14159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c98c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.136756:0:14159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c98c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.136763:0:14159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c98c8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.136770:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c98c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.136776:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115150.136780:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c98c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.136787:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c98c8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.136813:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:0.0:1787115150.136816:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787115150.136830:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c98c8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.136837:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c98c8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115150.136896:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+18:14410:x1873925602662272:12345-192.168.202.10@tcp:54:lfs.0 Request processed in 263us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115150.136904:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 32 00000100:00100000:3.0:1787115150.139425:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115150.139521:0:14160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602662528 00000100:00100000:0.0:1787115150.139530:0:14160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602662528 00000100:00100000:0.0:1787115150.139568:0:14160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:0.0:1787115150.139575:0:14160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+18:14410:x1873925602662528:12345-192.168.202.10@tcp:35:lfs.0 00000100:00100000:0.0:1787115150.139800:0:14160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+19:14410:x1873925602662528:12345-192.168.202.10@tcp:35:lfs.0 Request processed in 224us (381us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787115150.139807:0:14160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7 00000040:00080000:3.0:1787115150.149910:0:14191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787115150.219543:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787115150.219568:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06f636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624669440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787115150.219642:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787115150.220257:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624669440 00000100:00100000:3.0:1787115150.220269:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624669440 00000100:00100000:3.0:1787115150.220337:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787115150.220347:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624669440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787115150.220379:0:14797:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787115150.220452:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624669440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115150.220476:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787115150.220523:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06f636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624669440:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787115150.221038:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787115150.442284:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115150.442634:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602662784 00000100:00100000:3.0:1787115150.442644:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602662784 00000100:00100000:3.0:1787115150.442711:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 33 00000100:00100000:3.0:1787115150.442721:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+19:14442:x1873925602662784:12345-192.168.202.10@tcp:101:cat.0 00010000:00010000:3.0:1787115150.442901:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115150.442923:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c98cf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1941 expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115150.443015:0:14157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c98d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115150.443029:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c98d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115150.443041:0:14157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c98d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787115150.443051:0:14157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787115150.443298:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c98cf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1941 expref: 22 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115150.443316:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c98d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1941 expref: 21 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115150.443325:0:14157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:3.0:1787115150.443328:0:14157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787115150.443343:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aef418df600, rc 0) 00000100:00100000:3.0:1787115150.443443:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+21:14442:x1873925602662784:12345-192.168.202.10@tcp:101:cat.0 Request processed in 724us (1169us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1787115150.443450:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 33 00000100:00100000:2.0:1787115150.447289:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115150.447358:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115150.447413:0:14145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602663168 00000100:00100000:3.0:1787115150.447422:0:14145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602663168 00000100:00100000:3.0:1787115150.447486:0:14145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1 00000100:00100000:3.0:1787115150.447495:0:14145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+21:2364:x1873925602663168:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787115150.447511:0:14145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787115150.447534:0:14145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c98d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1941 expref: 21 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115150.447551:0:14145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:3.0:1787115150.447555:0:14145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787115150.447838:0:14145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+20:2364:x1873925602663168:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 342us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115150.447847:0:14145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1 00000100:00100000:0.0:1787115150.447932:0:14160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602663040 00000100:00100000:0.0:1787115150.447937:0:14160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602663040 00000100:00100000:0.0:1787115150.448001:0:14160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:0.0:1787115150.448009:0:14160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+20:14442:x1873925602663040:12345-192.168.202.10@tcp:35:cat.0 00000100:00100000:0.0:1787115150.448395:0:14160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+21:14442:x1873925602663040:12345-192.168.202.10@tcp:35:cat.0 Request processed in 386us (1114us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787115150.448402:0:14160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 8 00000100:00100000:2.0:1787115150.506179:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115150.506307:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602663424 00000100:00100000:0.0:1787115150.506329:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602663424 00000100:00100000:0.0:1787115150.506384:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 34 00000100:00100000:0.0:1787115150.506394:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+21:14448:x1873925602663424:12345-192.168.202.10@tcp:101:dd.0 00010000:00010000:0.0:1787115150.506416:0:14159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115150.506435:0:14159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c98e4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1948 expref: -99 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.506528:0:14159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3600/0x194cd781e88c98eb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.506542:0:14159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9889 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1925 expref: 22 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.506551:0:14159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c989e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d192c expref: 22 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.506560:0:14159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3600/0x194cd781e88c98eb lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.506600:0:14159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c989e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d192c expref: 22 pid: 15938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.506612:0:14159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c989e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d192c expref: 22 pid: 15938 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115150.506625:0:14159:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb73800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14159:1873925624669568:192.168.202.10@tcp:104: 00010000:00010000:0.0:1787115150.506730:0:14159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9889 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1925 expref: 22 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.506891:0:14159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9889 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1925 expref: 22 pid: 14159 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115150.506902:0:14159:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af06eb71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14159:1873925624669696:192.168.202.10@tcp:104: 00000100:00100000:0.0:1787115150.506926:0:14159:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af045a3e240 going to sleep for 11 seconds 00000100:00100000:2.0:1787115150.513799:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115150.513840:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115150.513954:0:16177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602663552 00000100:00100000:3.0:1787115150.513964:0:16177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602663552 00010000:00010000:3.0:1787115150.514004:0:16177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c989e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d192c expref: 23 pid: 15938 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115150.514043:0:16177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602663680 00000100:00100000:3.0:1787115150.514046:0:16177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602663680 00010000:00010000:3.0:1787115150.514057:0:16177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9889 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1925 expref: 24 pid: 14159 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115150.514077:0:16177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00100000:3.0:1787115150.514098:0:16177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739b5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+24:2364:x1873925602663552:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787115150.514138:0:16177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787115150.514145:0:16177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c989e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d192c expref: 24 pid: 15938 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115150.514157:0:16177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c989e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d192c expref: 24 pid: 15938 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115150.514187:0:16177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:3.0:1787115150.514206:0:16177:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3600/0x194cd781e88c98eb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115150.514216:0:16177:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3600/0x194cd781e88c98eb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115150.514239:0:16177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787115150.514287:0:16177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739b5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+24:2364:x1873925602663552:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 189us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115150.514295:0:16177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00100000:3.0:1787115150.514339:0:16177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12 00000100:00100000:3.0:1787115150.514345:0:16177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+23:2364:x1873925602663680:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787115150.514354:0:16177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787115150.514358:0:16177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9889 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1925 expref: 23 pid: 14159 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115150.514368:0:16177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9889 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1925 expref: 23 pid: 14159 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115150.514390:0:16177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:3.0:1787115150.514394:0:16177:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3600/0x194cd781e88c98eb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115150.514402:0:16177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3600/0x194cd781e88c98eb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115150.514410:0:16177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3600/0x194cd781e88c98eb lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115150.514426:0:16177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787115150.514442:0:16177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+23:2364:x1873925602663680:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 96us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115150.514448:0:16177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12 00010000:00010000:0.0:1787115150.515349:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c989e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d192c expref: 22 pid: 15938 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115150.515368:0:14159:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb73800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14159:1873925624669568:192.168.202.10@tcp:104: 00010000:00010000:0.0:1787115150.515379:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9889 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1925 expref: 21 pid: 14159 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115150.515389:0:14159:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af06eb71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14159:1873925624669696:192.168.202.10@tcp:104: 00010000:00010000:0.0:1787115150.515410:0:14159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3600/0x194cd781e88c98eb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.515419:0:14159:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3600/0x194cd781e88c98eb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.515436:0:14159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3600/0x194cd781e88c98eb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787115150.515457:0:14159:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787115150.515634:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c98e4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1948 expref: 22 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.515673:0:14159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3600/0x194cd781e88c98eb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1948 expref: 21 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.515682:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:0.0:1787115150.515685:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787115150.515688:0:14159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3600, rc 0) 00000100:00100000:0.0:1787115150.515746:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+21:14448:x1873925602663424:12345-192.168.202.10@tcp:101:dd.0 Request processed in 9347us (9578us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787115150.515754:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 34 00000100:00100000:2.0:1787115150.519519:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115150.519595:0:15938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602663936 00000100:00100000:0.0:1787115150.519604:0:15938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602663936 00000100:00100000:0.0:1787115150.519665:0:15938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 35 00000100:00100000:0.0:1787115150.519675:0:15938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+21:14448:x1873925602663936:12345-192.168.202.10@tcp:36:dd.0 00010000:00010000:0.0:1787115150.519951:0:15938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c98f9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.519968:0:15938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c98f9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.519979:0:15938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c98f9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787115150.520029:0:15938:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787115150.520064:0:15938:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dc697735 reply state 00000000c9ef9815 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c98f9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115150.520072:0:15938:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787115150.520448:0:15938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+24:14448:x1873925602663936:12345-192.168.202.10@tcp:36:dd.0 Request processed in 773us (939us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787115150.520456:0:15938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 35 00000020:00080000:0.0:1787115150.520461:0:15938:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787115150.523662:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c98f9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115150.523680:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c98f9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115150.523687:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c98f9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115150.523694:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115150.523699:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c98f9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115150.523723:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c98f9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115150.523753:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:2.0:1787115150.523756:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115150.523761:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c98f9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115150.523768:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2200/0x194cd781e88c98f9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115150.524749:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115150.524811:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602664064 00000100:00100000:0.0:1787115150.524826:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602664064 00000100:00100000:0.0:1787115150.524877:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 36 00000100:00100000:0.0:1787115150.524885:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+23:14448:x1873925602664064:12345-192.168.202.10@tcp:101:dd.0 00010000:00010000:0.0:1787115150.524906:0:14158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787115150.524922:0:14158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3400/0x194cd781e88c9900 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d194f expref: -99 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.524972:0:14158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3400/0x194cd781e88c9900 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d194f expref: 24 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.524985:0:14158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3400/0x194cd781e88c9900 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d194f expref: 24 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.525002:0:14158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:0.0:1787115150.525004:0:14158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787115150.525007:0:14158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af042cb3400, rc 0) 00000100:00100000:0.0:1787115150.525057:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+24:14448:x1873925602664064:12345-192.168.202.10@tcp:101:dd.0 Request processed in 172us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115150.525064:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 36 00000100:00100000:3.0:1787115150.537196:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115150.537357:0:16177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602664320 00000100:00100000:2.0:1787115150.537368:0:16177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602664320 00000100:00100000:2.0:1787115150.537439:0:16177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 2 00000100:00100000:2.0:1787115150.537450:0:16177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+24:14448:x1873925602664320:12345-192.168.202.10@tcp:103:dd.0 00010000:00010000:2.0:1787115150.537467:0:16177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115150.537495:0:16177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3400/0x194cd781e88c9900 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d194f expref: 24 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115150.537518:0:16177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:2.0:1787115150.537524:0:16177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115150.537596:0:16177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+23:14448:x1873925602664320:12345-192.168.202.10@tcp:103:dd.0 Request processed in 148us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115150.537604:0:16177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 2 00000100:00100000:1.0:1787115150.540489:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115150.540586:0:15938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602664448 00000100:00100000:0.0:1787115150.540595:0:15938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602664448 00000100:00100000:0.0:1787115150.540672:0:15938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 37 00000100:00100000:0.0:1787115150.540682:0:15938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+23:14448:x1873925602664448:12345-192.168.202.10@tcp:58:dd.0 00010000:00010000:0.0:1787115150.540992:0:15938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c9907 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.541010:0:15938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c9907 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115150.541021:0:15938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c9907 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787115150.543310:0:15938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787115150.543533:0:15938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787115150.543670:0:15938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787115150.543951:0:15938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+23:14448:x1873925602664448:12345-192.168.202.10@tcp:58:dd.0 Request processed in 3265us (3467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115150.543962:0:15938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 37 00000100:00100000:0.0:1787115150.546091:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115150.546278:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602664576 00000100:00100000:2.0:1787115150.546287:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602664576 00000100:00100000:2.0:1787115150.546332:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 38 00000100:00100000:2.0:1787115150.546355:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+23:14448:x1873925602664576:12345-192.168.202.10@tcp:101:dd.0 00010000:00010000:2.0:1787115150.546376:0:14158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115150.546395:0:14158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c990e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1956 expref: -99 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115150.546457:0:14158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c9907 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115150.546468:0:14158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c990e lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1956 expref: 24 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115150.546485:0:14158:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c9907 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115150.546498:0:14158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c990e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1956 expref: 24 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115150.546512:0:14158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:2.0:1787115150.546515:0:14158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787115150.546519:0:14158:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c990e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1956 expref: 24 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115150.546527:0:14158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030400, rc 0) 00000100:00100000:2.0:1787115150.546577:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+24:14448:x1873925602664576:12345-192.168.202.10@tcp:101:dd.0 Request processed in 224us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115150.546591:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 38 00000100:00100000:3.0:1787115150.716538:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115150.716594:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115150.716613:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115150.716643:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115150.716676:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115150.716699:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115150.716723:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602665088 00000100:00100000:3.0:1787115150.716731:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602665088 00000100:00100000:3.0:1787115150.716775:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 23 00000100:00100000:3.0:1787115150.716783:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+11:2362:x1873925602665088:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787115150.716899:0:14153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602664704 00000100:00100000:1.0:1787115150.716904:0:14153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602664704 00000100:00100000:1.0:1787115150.716944:0:14153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 120 00000100:00100000:1.0:1787115150.716950:0:14153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af047e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+13:2362:x1873925602664704:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787115150.716998:0:14153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af047e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5965936-b623-4bea-9c39-d92821f4f81e+13:2362:x1873925602664704:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 48us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115150.717005:0:14153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 120 00000100:00100000:3.0:1787115150.717181:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+11:2362:x1873925602665088:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 399us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115150.717204:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 23 00000100:00100000:2.0:1787115150.717323:0:15476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602664960 00000100:00100000:2.0:1787115150.717327:0:15476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602664960 00000100:00100000:2.0:1787115150.717367:0:15476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602665216 00000100:00100000:2.0:1787115150.717369:0:15476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602665216 00000100:00100000:2.0:1787115150.717381:0:15476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602664832 00000100:00100000:2.0:1787115150.717383:0:15476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602664832 00000100:00100000:2.0:1787115150.717392:0:15476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602665344 00000100:00100000:2.0:1787115150.717394:0:15476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602665344 00000100:00100000:2.0:1787115150.717408:0:15476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:2.0:1787115150.717414:0:15476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+5:2362:x1873925602664960:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787115150.717451:0:15476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+5:2362:x1873925602664960:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 37us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115150.717457:0:15476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:2.0:1787115150.717469:0:15476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 14 00000100:00100000:2.0:1787115150.717474:0:15476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+5:2362:x1873925602665216:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787115150.717492:0:15476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+5:2362:x1873925602665216:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 18us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115150.717497:0:15476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 14 00000100:00100000:2.0:1787115150.717507:0:15476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15 00000100:00100000:2.0:1787115150.717513:0:15476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+5:2362:x1873925602664832:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787115150.717532:0:15476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+5:2362:x1873925602664832:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 20us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115150.717538:0:15476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15 00000100:00100000:2.0:1787115150.717548:0:15476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16 00000100:00100000:2.0:1787115150.717553:0:15476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+5:2362:x1873925602665344:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:2.0:1787115150.717571:0:15476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+5:2362:x1873925602665344:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 17us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115150.717584:0:15476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16 00000100:00080000:3.0:1787115150.720236:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787115150.720245:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787115150.858408:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787115151.173929:0:14191:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787115151.173938:0:14191:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787115151.173976:0:14191:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787115151.173982:0:14191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787115151.174142:0:14191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aec000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14191:1873925624669824:192.168.202.10@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787115151.174303:0:14191:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af06f5fa180 going to sleep for 11 seconds 00000100:00100000:2.0:1787115151.191086:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115151.191703:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602665472 00000100:00100000:0.0:1787115151.191712:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602665472 00000100:00100000:0.0:1787115151.191780:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:0.0:1787115151.191790:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:278330ce-de2f-4eb0-ab55-65b736a927fb+25:14449:x1873925602665472:12345-192.168.202.10@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787115151.191871:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:278330ce-de2f-4eb0-ab55-65b736a927fb+25:14449:x1873925602665472:12345-192.168.202.10@tcp:900:lhsmtool_posix.0 Request processed in 83us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115151.191879:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:3.0:1787115151.192461:0:14191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aec000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14191:1873925624669824:192.168.202.10@tcp:107:hsm_cdtr.0 00000100:00080000:2.0:1787115151.193469:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787115151.199538:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115151.200215:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602665600 00000100:00100000:2.0:1787115151.200225:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602665600 00000100:00100000:2.0:1787115151.200293:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 39 00000100:00100000:2.0:1787115151.200304:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+24:14449:x1873925602665600:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787115151.200340:0:14158:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787115151.200461:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+24:14449:x1873925602665600:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 Request processed in 159us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115151.200469:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 39 00000100:00100000:0.0:1787115151.210214:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115151.210524:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602665728 00000100:00100000:3.0:1787115151.210535:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602665728 00000100:00100000:3.0:1787115151.210602:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 40 00000100:00100000:3.0:1787115151.210612:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+24:14449:x1873925602665728:12345-192.168.202.10@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787115151.210692:0:14157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c9915 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.210710:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c9915 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.210723:0:14157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c9915 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.210737:0:14157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c991c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.210745:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c991c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.210770:0:14157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c991c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.210792:0:14157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df400/0x194cd781e88c9923 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.210801:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df400/0x194cd781e88c9923 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.210819:0:14157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df400/0x194cd781e88c9923 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787115151.210855:0:14157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787115151.210859:0:14157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787115151.210875:0:14157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df400/0x194cd781e88c9923 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.210885:0:14157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c9915 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.210892:0:14157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c9915 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.210898:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c9915 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.210905:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aef418df600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115151.210908:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c9915 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.210915:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c9915 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.210932:0:14157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8af051ecb200) 00010000:00010000:3.0:1787115151.210935:0:14157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115151.210940:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c9915 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.210946:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df600/0x194cd781e88c9915 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.210959:0:14157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c991c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.210965:0:14157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c991c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.210971:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c991c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.210976:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aef418de600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115151.210979:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c991c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.210984:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c991c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.210990:0:14157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8af0821c0f00) 00010000:00010000:3.0:1787115151.210992:0:14157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115151.210995:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c991c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.211001:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418de600/0x194cd781e88c991c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.211022:0:14157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df400/0x194cd781e88c9923 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.211028:0:14157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df400/0x194cd781e88c9923 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.211034:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df400/0x194cd781e88c9923 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.211039:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aef418df400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:3.0:1787115151.211041:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df400/0x194cd781e88c9923 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.211048:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df400/0x194cd781e88c9923 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.211055:0:14157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:3.0:1787115151.211057:0:14157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787115151.211060:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df400/0x194cd781e88c9923 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.211066:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aef418df400/0x194cd781e88c9923 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115151.216915:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+24:14449:x1873925602665728:12345-192.168.202.10@tcp:34:lhsmtool_posix.0 Request processed in 6290us (6700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115151.216932:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 40 00000100:00100000:3.0:1787115151.219737:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115151.219924:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602665984 00000100:00100000:2.0:1787115151.219935:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602665984 00000100:00100000:2.0:1787115151.220000:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 41 00000100:00100000:2.0:1787115151.220010:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+24:14449:x1873925602665984:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787115151.220034:0:14158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115151.220075:0:14158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c992a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d195d expref: -99 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.220207:0:14158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9931 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.220241:0:14158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9931 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.220254:0:14158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9931 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115151.220268:0:14158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787115151.220382:0:14158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9931 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.220389:0:14158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9931 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.220396:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9931 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.220403:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040031000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115151.220407:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9931 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.220414:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9931 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.220425:0:14158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:2.0:1787115151.220428:0:14158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787115151.220432:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9931 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.220439:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9931 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.220479:0:14158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c992a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d195d expref: 26 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.220495:0:14158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8af051ecb200) 00010000:00010000:2.0:1787115151.220497:0:14158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787115151.220501:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c992a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d195d expref: 26 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.220510:0:14158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040031600, rc 0) 00000100:00100000:2.0:1787115151.220563:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+25:14449:x1873925602665984:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 554us (835us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1787115151.220570:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 41 00000100:00100000:3.0:1787115151.231868:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115151.231974:0:15938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602666112 00000100:00100000:0.0:1787115151.231986:0:15938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602666112 00000100:00100000:0.0:1787115151.232045:0:15938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 42 00000100:00100000:0.0:1787115151.232054:0:15938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0513a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+25:14449:x1873925602666112:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787115151.232136:0:15938:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787115151.232243:0:15938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0513a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+25:14449:x1873925602666112:12345-192.168.202.10@tcp:53:lhsmtool_posix.0 Request processed in 189us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115151.232251:0:15938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 42 00000100:00100000:0.0:1787115151.252226:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115151.252967:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602666368 00000100:00100000:2.0:1787115151.252978:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602666368 00000100:00100000:2.0:1787115151.253036:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 43 00000100:00100000:2.0:1787115151.253045:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+25:14449:x1873925602666368:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787115151.253065:0:14158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115151.253084:0:14158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c993f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1964 expref: -99 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787115151.253955:0:14158:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1787115151.253962:0:14158:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1787115151.254009:0:14158:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1787115151.254268:0:14158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9946 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.254295:0:14158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9946 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.254308:0:14158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9946 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.255525:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c993f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1964 expref: 28 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.255550:0:14158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9946 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1964 expref: 27 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.255561:0:14158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8af0514c6b00) 00010000:00010000:2.0:1787115151.255564:0:14158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787115151.255568:0:14158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040031000, rc 0) 00000100:00100000:2.0:1787115151.255808:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+27:14449:x1873925602666368:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 2762us (3591us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787115151.255817:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 43 00000100:00100000:3.0:1787115151.270799:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115151.271381:0:15938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602666624 00000100:00100000:0.0:1787115151.271391:0:15938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602666624 00000100:00100000:0.0:1787115151.271452:0:15938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 44 00000100:00100000:0.0:1787115151.271462:0:15938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+27:14449:x1873925602666624:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787115151.271517:0:15938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787115151.271543:0:15938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031000/0x194cd781e88c9946 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1964 expref: 27 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.271562:0:15938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8af0514c6b00) 00010000:00010000:0.0:1787115151.271572:0:15938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787115151.271602:0:15938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3400/0x194cd781e88c9954 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.271615:0:15938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3400/0x194cd781e88c9954 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.271624:0:15938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3400/0x194cd781e88c9954 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.271638:0:15938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c995b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4d4b167e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.271655:0:15938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c995b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4d4b167e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.271674:0:15938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c995b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4d4b167e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.271741:0:15938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3400/0x194cd781e88c9954 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.271748:0:15938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3400/0x194cd781e88c9954 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.271756:0:15938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3400/0x194cd781e88c9954 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.271762:0:15938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3400 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115151.271765:0:15938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3400/0x194cd781e88c9954 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.271774:0:15938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3400/0x194cd781e88c9954 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.271782:0:15938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8af0514c6800) 00010000:00010000:0.0:1787115151.271784:0:15938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115151.271788:0:15938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3400/0x194cd781e88c9954 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.271794:0:15938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3400/0x194cd781e88c9954 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.271803:0:15938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c995b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4d4b167e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.271820:0:15938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c995b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4d4b167e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.271831:0:15938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c995b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4d4b167e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.271836:0:15938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115151.271839:0:15938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c995b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4d4b167e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.271846:0:15938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c995b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4d4b167e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.271853:0:15938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x4d4b167e (ffff8af051ecbb00) 00010000:00010000:0.0:1787115151.271855:0:15938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787115151.271857:0:15938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c995b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4d4b167e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.271864:0:15938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c995b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4d4b167e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115151.271946:0:15938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+26:14449:x1873925602666624:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 Request processed in 484us (1154us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787115151.271953:0:15938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 44 00000100:00100000:0.0:1787115151.281497:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115151.282365:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602666752 00000100:00100000:2.0:1787115151.282376:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602666752 00000100:00100000:2.0:1787115151.282442:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 45 00000100:00100000:2.0:1787115151.282451:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+26:14449:x1873925602666752:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787115151.282471:0:14159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115151.282494:0:14159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9962 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d196b expref: -99 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.282534:0:14159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9969 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.282548:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9969 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.282560:0:14159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9969 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.282682:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9962 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d196b expref: 28 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.282702:0:14159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030a00/0x194cd781e88c9969 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d196b expref: 27 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.282710:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8af0514c6100) 00010000:00010000:2.0:1787115151.282713:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787115151.282717:0:14159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030a00, rc 0) 00000100:00100000:2.0:1787115151.282770:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+27:14449:x1873925602666752:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 320us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115151.282776:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 45 00000100:00100000:1.0:1787115151.293491:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115151.293992:0:15938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602667008 00000100:00100000:0.0:1787115151.294002:0:15938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602667008 00000100:00100000:0.0:1787115151.294066:0:15938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 46 00000100:00100000:0.0:1787115151.294076:0:15938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+27:14449:x1873925602667008:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787115151.294210:0:15938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c9970 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.294237:0:15938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c9970 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.294248:0:15938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c9970 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787115151.294770:0:15938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1787115151.294780:0:15938:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 480280671940ns, next at 481280669922ns, rc = 0 00000004:00010000:0.0:1787115151.294872:0:15938:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000091be3d8 reply state 00000000ac2a3182 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c9970 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115151.294883:0:15938:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787115151.294972:0:15938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+29:14449:x1873925602667008:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 Request processed in 896us (1488us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1787115151.294979:0:15938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 46 00000100:00100000:1.0:1787115151.301821:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115151.301922:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602667136 00000100:00100000:2.0:1787115151.301934:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602667136 00000100:00100000:2.0:1787115151.301988:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 47 00000100:00100000:2.0:1787115151.301997:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+29:14449:x1873925602667136:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787115151.302022:0:14159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115151.302043:0:14159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9977 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1972 expref: -99 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.302102:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9977 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1972 expref: 30 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.302151:0:14159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9977 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1972 expref: 30 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.302182:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8af0514c6100) 00010000:00010000:2.0:1787115151.302186:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787115151.302189:0:14159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040031600, rc 0) 00000100:00100000:2.0:1787115151.302240:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+30:14449:x1873925602667136:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 245us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115151.302247:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 47 00010000:00010000:0.0:1787115151.302748:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c9970 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.302759:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c9970 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.302767:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c9970 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.302773:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2000 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:0.0:1787115151.302777:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c9970 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.302785:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c9970 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.302818:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8af0514c6100) 00010000:00010000:0.0:1787115151.302821:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787115151.302826:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c9970 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.302833:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb2000/0x194cd781e88c9970 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115151.306048:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115151.306207:0:15476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602667264 00000100:00100000:2.0:1787115151.306217:0:15476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602667264 00000100:00100000:2.0:1787115151.306270:0:15476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 12 00000100:00100000:2.0:1787115151.306288:0:15476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+5:2364:x1873925602667264:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787115151.306676:0:15476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+6:2364:x1873925602667264:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 Request processed in 398us (637us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787115151.306684:0:15476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 12 00000100:00100000:1.0:1787115151.319242:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115151.319399:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602667520 00000100:00100000:2.0:1787115151.319413:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602667520 00000100:00100000:2.0:1787115151.319538:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00100000:2.0:1787115151.319550:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+29:14449:x1873925602667520:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787115151.320036:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+30:14449:x1873925602667520:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 Request processed in 486us (805us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1787115151.320045:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 9 00000100:00100000:3.0:1787115151.326040:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115151.327540:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602667776 00000100:00100000:0.0:1787115151.327551:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602667776 00000100:00100000:1.0:1787115151.327748:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 48 00000100:00100000:1.0:1787115151.327761:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+30:14449:x1873925602667776:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787115151.327889:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+30:14449:x1873925602667776:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 Request processed in 130us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115151.327897:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 48 00000100:00100000:1.0:1787115151.332036:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115151.332092:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602667904 00000100:00100000:2.0:1787115151.332102:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602667904 00000100:00100000:2.0:1787115151.332176:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 49 00000100:00100000:2.0:1787115151.332185:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+30:14449:x1873925602667904:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787115151.332219:0:14159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115151.332240:0:14159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c997e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1979 expref: -99 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.332334:0:14159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c9985 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.332349:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c9985 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.332362:0:14159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c9985 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787115151.332399:0:14159:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787115151.332528:0:14159:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c9985 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.332556:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c997e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1979 expref: 32 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.332575:0:14159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c9985 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1979 expref: 31 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.332584:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8af0514c6100) 00010000:00010000:2.0:1787115151.332587:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787115151.332590:0:14159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030e00, rc 0) 00000100:00100000:2.0:1787115151.332739:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+31:14449:x1873925602667904:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 554us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115151.332747:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 49 00000100:00100000:0.0:1787115151.335277:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115151.335400:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602668032 00000100:00100000:2.0:1787115151.335409:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602668032 00000100:00100000:2.0:1787115151.335555:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:2.0:1787115151.335565:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+6:2363:x1873925602668032:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787115151.335583:0:14793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787115151.335609:0:14793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c998c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1980 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787115151.335636:0:14793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a853690, blocks: 0x1 00010000:00010000:2.0:1787115151.335664:0:14793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1787115151.335669:0:14793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115151.335679:0:14793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c998c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1980 expref: 7 pid: 14793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.335695:0:14793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c998c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1980 expref: 7 pid: 14793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.335708:0:14793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af040030200, rc 0) 00000100:00100000:2.0:1787115151.335771:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+7:2363:x1873925602668032:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 207us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115151.335778:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:3.0:1787115151.338466:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115151.338749:0:15938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602668288 00000100:00100000:0.0:1787115151.338758:0:15938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602668288 00000100:00100000:0.0:1787115151.338825:0:15938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 50 00000100:00100000:0.0:1787115151.338835:0:15938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+31:14449:x1873925602668288:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787115151.338944:0:15938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+31:14449:x1873925602668288:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 Request processed in 110us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115151.338952:0:15938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 50 00000100:00100000:1.0:1787115151.342051:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115151.342147:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602668416 00000100:00100000:3.0:1787115151.342158:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602668416 00000100:00100000:3.0:1787115151.342223:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 51 00000100:00100000:3.0:1787115151.342232:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+31:14449:x1873925602668416:12345-192.168.202.10@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787115151.397437:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:0.0:1787115151.397451:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1787115151.397491:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1787115151.397512:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:0.0:1787115151.397525:0:5807:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1787115151.397836:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787115151.397857:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af045055c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624669952:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787115151.397927:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115151.398227:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+14:14449:x1873925602668416:12345-192.168.202.10@tcp:44:lhsmtool_posix.0 Request processed in 55993us (56182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115151.398240:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 51 00000100:00100000:2.0:1787115151.398278:0:15476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624669952 00000100:00100000:2.0:1787115151.398287:0:15476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624669952 00000100:00100000:2.0:1787115151.398400:0:15476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787115151.398408:0:15476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af045055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624669952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787115151.398568:0:15476:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787115151.398572:0:15476:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787115151.398575:0:15476:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787115151.398577:0:15476:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787115152 -> 1787115152 00002000:00010000:2.0:1787115151.398579:0:15476:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787115151.398631:0:15476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af045055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1873925624669952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 224us (703us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787115151.398637:0:15476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1787115151.398689:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8af045055c00/2, rc 0, transno 8589934595 00000100:00100000:2.0:1787115151.398695:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af045055c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624669952:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787115151.401862:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00080000:0.0:1787115151.402072:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787115151.402166:0:14795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602668544 00000100:00100000:3.0:1787115151.402176:0:14795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602668544 00000100:00100000:3.0:1787115151.402258:0:14795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15 00000100:00100000:3.0:1787115151.402268:0:14795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+7:2364:x1873925602668544:12345-192.168.202.10@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787115151.402365:0:14795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+7:2364:x1873925602668544:12345-192.168.202.10@tcp:16:lhsmtool_posix.0 Request processed in 99us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115151.402373:0:14795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15 00000100:00100000:0.0:1787115151.404361:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115151.404505:0:15938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602668800 00000100:00100000:2.0:1787115151.404515:0:15938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602668800 00000100:00100000:2.0:1787115151.404614:0:15938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 52 00000100:00100000:2.0:1787115151.404624:0:15938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+14:14449:x1873925602668800:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787115151.404688:0:15938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115151.404715:0:15938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c9985 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1979 expref: 14 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.404737:0:15938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8af0514c6100) 00010000:00010000:2.0:1787115151.404742:0:15938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787115151.404771:0:15938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9993 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.404786:0:15938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9993 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.404961:0:15938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9993 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787115151.405344:0:15938:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000dc6dbd9 reply state 000000002f1fa29c transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9993 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115151.405356:0:15938:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787115151.405553:0:15938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+15:14449:x1873925602668800:12345-192.168.202.10@tcp:36:lhsmtool_posix.0 Request processed in 929us (1197us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787115151.405562:0:15938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 52 00000100:00100000:0.0:1787115151.414558:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00010000:00010000:2.0:1787115151.415164:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9993 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.415179:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9993 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.415186:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9993 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.415192:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030c00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115151.415196:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9993 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.415203:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9993 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.415220:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8af0514c6100) 00010000:00010000:2.0:1787115151.415223:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115151.415228:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9993 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.415254:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030c00/0x194cd781e88c9993 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115151.415379:0:15476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602668928 00000100:00100000:3.0:1787115151.415389:0:15476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602668928 00000100:00100000:3.0:1787115151.415451:0:15476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 16 00000100:00100000:3.0:1787115151.415461:0:15476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+7:14449:x1873925602668928:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787115151.415480:0:15476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787115151.415496:0:15476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000861ffde9/0x194cd781e88c999a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fd6aedd2d5d1987 expref: -99 pid: 15476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.415529:0:15476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c998c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1980 expref: 8 pid: 14793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.415538:0:15476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115151.415548:0:15476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115151.415554:0:15476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000861ffde9/0x194cd781e88c999a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1987 expref: 8 pid: 15476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.415589:0:15476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c998c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1980 expref: 8 pid: 14793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.415691:0:15476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c998c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1980 expref: 8 pid: 14793 timeout: 580 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115151.415706:0:15476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af045055180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15476:1873925624670080:192.168.202.10@tcp:104: 00000100:00100000:3.0:1787115151.415778:0:15476:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0451dad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787115151.418861:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115151.418932:0:14144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602669056 00000100:00100000:2.0:1787115151.418940:0:14144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602669056 00010000:00010000:2.0:1787115151.418976:0:14144:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c998c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1980 expref: 9 pid: 14793 timeout: 580 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115151.419016:0:14144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:2.0:1787115151.419026:0:14144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+9:2364:x1873925602669056:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115151.419040:0:14144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115151.419063:0:14144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c998c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1980 expref: 9 pid: 14793 timeout: 580 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.419076:0:14144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c998c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1980 expref: 9 pid: 14793 timeout: 580 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.419098:0:14144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115151.419103:0:14144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115151.419141:0:14144:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000861ffde9/0x194cd781e88c999a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1987 expref: 9 pid: 15476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.419153:0:14144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000861ffde9/0x194cd781e88c999a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1987 expref: 9 pid: 15476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.419220:0:14144:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000861ffde9/0x194cd781e88c999a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1987 expref: 9 pid: 15476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115151.419233:0:14144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ef800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14144:1873925624670208:192.168.202.10@tcp:105: 00000100:00100000:2.0:1787115151.419295:0:14144:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051e4b9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787115151.419876:0:15476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c998c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1980 expref: 9 pid: 14793 timeout: 580 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115151.419893:0:15476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af045055180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15476:1873925624670080:192.168.202.10@tcp:104: 00010000:00010000:3.0:1787115151.419917:0:15476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000861ffde9/0x194cd781e88c999a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1987 expref: 8 pid: 15476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.419929:0:15476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aef418df400, rc 0) 00000100:00100000:3.0:1787115151.419970:0:15476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+8:14449:x1873925602668928:12345-192.168.202.10@tcp:101:lhsmtool_posix.0 Request processed in 4510us (5421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115151.419977:0:15476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 16 00000100:00100000:1.0:1787115151.424439:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115151.424540:0:14144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ef800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14144:1873925624670208:192.168.202.10@tcp:105: 00010000:00010000:2.0:1787115151.424566:0:14144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787115151.424636:0:14144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+7:2364:x1873925602669056:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 5611us (5782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115151.424654:0:14144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 13 00000100:00100000:0.0:1787115151.424879:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602669184 00000100:00100000:0.0:1787115151.424886:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602669184 00000100:00100000:0.0:1787115151.424941:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 17 00000100:00100000:0.0:1787115151.424949:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+7:2364:x1873925602669184:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787115151.429960:0:14793:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787115151.429970:0:14793:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787115151 00002000:00010000:1.0:1787115151.429973:0:14793:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787115150 00002000:00010000:1.0:1787115151.429975:0:14793:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787115152 -> 1787115151 00002000:00010000:1.0:1787115151.429978:0:14793:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787115151.430056:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+8:2364:x1873925602669184:12345-192.168.202.10@tcp:2:lhsmtool_posix.0 Request processed in 5102us (5630us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787115151.430066:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 17 00000100:00100000:1.0:1787115151.435997:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115151.436078:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602669312 00000100:00100000:2.0:1787115151.436089:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602669312 00000100:00100000:2.0:1787115151.436187:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 18 00000100:00100000:2.0:1787115151.436198:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+8:2363:x1873925602669312:12345-192.168.202.10@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787115151.436250:0:14796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c99a1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.436272:0:14796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000861ffde9/0x194cd781e88c999a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1987 expref: 8 pid: 15476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.436280:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115151.436285:0:14796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787115151.436290:0:14796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c99a1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.436345:0:14796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000861ffde9/0x194cd781e88c999a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1987 expref: 8 pid: 15476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.436360:0:14796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000861ffde9/0x194cd781e88c999a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1987 expref: 8 pid: 15476 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115151.436375:0:14796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14796:1873925624670336:192.168.202.10@tcp:104: 00000100:00100000:2.0:1787115151.436471:0:14796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051e4b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787115151.439547:0:14796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14796:1873925624670336:192.168.202.10@tcp:104: 00010000:00010000:2.0:1787115151.439575:0:14796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c99a1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115151.444885:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115151.445548:0:16177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602669440 00000100:00100000:2.0:1787115151.445560:0:16177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602669440 00010000:00010000:2.0:1787115151.445611:0:16177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000861ffde9/0x194cd781e88c999a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1987 expref: 9 pid: 15476 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115151.445664:0:16177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 14 00000100:00100000:2.0:1787115151.445675:0:16177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af07f6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+9:2363:x1873925602669440:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787115151.445692:0:16177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787115151.445717:0:16177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000861ffde9/0x194cd781e88c999a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1987 expref: 9 pid: 15476 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.445749:0:16177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000861ffde9/0x194cd781e88c999a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1987 expref: 9 pid: 15476 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.445771:0:16177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000861ffde9/0x194cd781e88c999a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1987 expref: 9 pid: 15476 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.445789:0:16177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787115151.445793:0:16177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787115151.445798:0:16177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c99a1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.446525:0:16177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c99a1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.446565:0:16177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787115151.446748:0:14796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c99a1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.446759:0:14796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c99a1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.446785:0:14796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c99a1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.446794:0:14796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c99a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.446801:0:14796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c99a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.446818:0:14796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030c00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787115151.446822:0:14796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c99a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.446831:0:14796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c99a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.446845:0:14796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c99a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.446867:0:14796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000942ec37d/0x194cd781e88c99a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115151.446960:0:16177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+8:2363:x1873925602669440:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 1284us (2082us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115151.446968:0:16177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 14 00000100:00100000:0.0:1787115151.451135:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af07f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+7:2363:x1873925602669312:12345-192.168.202.10@tcp:1:lhsmtool_posix.0 Request processed in 14903us (15111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115151.451149:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 18 00000100:00100000:0.0:1787115151.465206:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115151.465284:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602669696 00000100:00100000:2.0:1787115151.465295:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602669696 00000100:00100000:2.0:1787115151.465357:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 53 00000100:00100000:2.0:1787115151.465367:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+14:14449:x1873925602669696:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787115151.465460:0:14159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c99a8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.465494:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c99a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.465506:0:14159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c99a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.465766:0:14159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c99af lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.465778:0:14159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9977 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1972 expref: 15 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.465785:0:14159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c99af lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.465831:0:14159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9977 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1972 expref: 15 pid: 14159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.465844:0:14159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9977 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1972 expref: 15 pid: 14159 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115151.465860:0:14159:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14159:1873925624670464:192.168.202.10@tcp:104: 00000100:00100000:2.0:1787115151.465932:0:14159:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af051e4b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787115151.478097:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115151.478235:0:14143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602669824 00000100:00100000:0.0:1787115151.478244:0:14143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602669824 00010000:00010000:0.0:1787115151.478280:0:14143:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9977 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1972 expref: 16 pid: 14159 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115151.478314:0:14143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 15 00000100:00100000:0.0:1787115151.478322:0:14143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+16:2364:x1873925602669824:12345-192.168.202.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787115151.478336:0:14143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787115151.478342:0:14143:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9977 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1972 expref: 16 pid: 14159 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.478355:0:14143:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9977 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1972 expref: 16 pid: 14159 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.478377:0:14143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8af0514c6100) 00010000:00010000:0.0:1787115151.478382:0:14143:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c99af lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.478391:0:14143:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c99af lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.478410:0:14143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c99af lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.478441:0:14143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787115151.478490:0:14143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+16:2364:x1873925602669824:12345-192.168.202.10@tcp:103:ldlm_bl.0 Request processed in 168us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115151.478498:0:14143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 15 00010000:00010000:2.0:1787115151.478967:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c9977 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1972 expref: 15 pid: 14159 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115151.478984:0:14159:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14159:1873925624670464:192.168.202.10@tcp:104: 00010000:00010000:2.0:1787115151.479007:0:14159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c99af lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.479024:0:14159:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c99af lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.479030:0:14159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c99af lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787115151.479284:0:14159:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787115151.479442:0:14159:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787115151.479488:0:14159:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787115151.479568:0:14159:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14159:1873925624670592:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787115151.479887:0:14159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115151.479919:0:14159:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af0438e8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787115151.481591:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624670592 00000100:00100000:3.0:1787115151.481602:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624670592 00000100:00100000:3.0:1787115151.481681:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787115151.481691:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14159:x1873925624670592:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787115151.481816:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14159:x1873925624670592:12345-0@lo:1000:mdt00_002.0 Request processed in 126us (1929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115151.481824:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787115151.485177:0:14159:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14159:1873925624670592:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787115151.486066:0:14159:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787115151.486362:0:14159:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14159:1873925624670720:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787115151.486550:0:14159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115151.486580:0:14159:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050faa000 going to sleep for 11 seconds 00000100:00100000:3.0:1787115151.488697:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624670720 00000100:00100000:3.0:1787115151.488710:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624670720 00000100:00100000:3.0:1787115151.488773:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787115151.488782:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14159:x1873925624670720:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787115151.489024:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14159:x1873925624670720:12345-0@lo:1000:mdt00_002.0 Request processed in 243us (2474us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787115151.489033:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787115151.489047:0:14159:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14159:1873925624670720:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787115151.489090:0:14159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c99af lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.489101:0:14159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c99af lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.489134:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c99af lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.489141:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030200 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115151.489158:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c99af lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.489177:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c99af lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.489192:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8af0514c6100) 00010000:00010000:2.0:1787115151.489195:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787115151.489199:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c99af lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.489206:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030200/0x194cd781e88c99af lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.489238:0:14159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c9907 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.489245:0:14159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c9907 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.489251:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c9907 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.489256:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb3e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115151.489259:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c9907 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.489265:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c9907 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.489273:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:2.0:1787115151.489275:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787115151.489288:0:14159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c990e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1956 expref: 18 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.489300:0:14159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c990e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1956 expref: 18 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.489310:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c990e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1956 expref: 18 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.489365:0:14159:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030400/0x194cd781e88c990e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.10@tcp remote: 0x7fd6aedd2d5d1956 expref: 18 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115151.489379:0:14159:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14159:1873925624670848:192.168.202.10@tcp:105: 00000100:00100000:2.0:1787115151.489601:0:14159:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af050faa600 going to sleep for 11 seconds 00000100:00100000:1.0:1787115151.492872:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115151.493040:0:14160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602669952 00000100:00100000:0.0:1787115151.493050:0:14160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602669952 00000100:00100000:0.0:1787115151.493129:0:14160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 10 00000100:00100000:0.0:1787115151.493140:0:14160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af042a07850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+19:14448:x1873925602669952:12345-192.168.202.10@tcp:49:dd.0 00000100:00100000:0.0:1787115151.493261:0:14160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af042a07850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:278330ce-de2f-4eb0-ab55-65b736a927fb+19:14448:x1873925602669952:12345-192.168.202.10@tcp:49:dd.0 Request processed in 122us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115151.493269:0:14160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 10 00000100:00100000:2.0:1787115151.495688:0:14159:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14159:1873925624670848:192.168.202.10@tcp:105: 00010000:00010000:2.0:1787115151.495715:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c9907 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.495726:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af042cb3e00/0x194cd781e88c9907 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.495759:0:14159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c99b6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.495773:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c99b6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.495784:0:14159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c99b6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.495987:0:14159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c99b6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.495993:0:14159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c99b6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.496000:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c99b6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.496006:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040031600 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115151.496010:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c99b6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.496017:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c99b6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.496029:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:2.0:1787115151.496032:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787115151.496036:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c99b6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.496041:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040031600/0x194cd781e88c99b6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.496050:0:14159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c99a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.496056:0:14159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c99a8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.496061:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c99a8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.496071:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030e00 already unused, calling callback (ffffffffc1eff4f0) 00010000:00010000:2.0:1787115151.496075:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c99a8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.496080:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c99a8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.496088:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8af0514c6d00) 00010000:00010000:2.0:1787115151.496090:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787115151.496092:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c99a8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.496097:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c99a8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14159 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115151.496359:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+18:14449:x1873925602669696:12345-192.168.202.10@tcp:57:lhsmtool_posix.0 Request processed in 30992us (31160us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787115151.496371:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 53 00000020:00080000:2.0:1787115151.496376:0:14159:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787115151.497007:0:14191:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787115151.497013:0:14191:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787115151.497046:0:14191:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787115151.497051:0:14191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787115151.505293:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115151.505371:0:14161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602670208 00000100:00100000:2.0:1787115151.505380:0:14161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602670208 00000100:00100000:2.0:1787115151.505443:0:14161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 11 00000100:00100000:2.0:1787115151.505453:0:14161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+18:14449:x1873925602670208:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787115151.506170:0:14161:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787115151.506277:0:14161:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787115151.506320:0:14161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c99bd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.506336:0:14161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c99bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.506354:0:14161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c99bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.506363:0:14161:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c99bd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.506368:0:14161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c99bd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.506373:0:14161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c99bd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.506397:0:14161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787115151.506477:0:14161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+20:14449:x1873925602670208:12345-192.168.202.10@tcp:35:lhsmtool_posix.0 Request processed in 1024us (1192us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787115151.506485:0:14161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 11 00000020:00080000:2.0:1787115151.506490:0:14161:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787115151.506851:0:14147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787115151.506860:0:14147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c99bd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.506868:0:14147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030e00 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:3.0:1787115151.506872:0:14147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c99bd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.506880:0:14147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c99bd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.506893:0:14147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8af0514c6100) 00010000:00010000:3.0:1787115151.506896:0:14147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787115151.506908:0:14147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c99bd lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.506914:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af040030e00/0x194cd781e88c99bd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.506927:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115151.506929:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787115151.506931:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787115151.712923:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115151.712967:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115151.712998:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115151.713151:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115151.715476:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:3.0:1787115151.718034:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602670464 00000100:00100000:3.0:1787115151.718050:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602670464 00000100:00100000:3.0:1787115151.718139:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602670336 00000100:00100000:3.0:1787115151.718143:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602670336 00000100:00100000:3.0:1787115151.718162:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602670592 00000100:00100000:3.0:1787115151.718165:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602670592 00000100:00100000:3.0:1787115151.718178:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602670720 00000100:00100000:3.0:1787115151.718181:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602670720 00000100:00100000:3.0:1787115151.718206:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:3.0:1787115151.718218:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+10:2363:x1873925602670464:12345-192.168.202.10@tcp:4:dd.0 00002000:00010000:3.0:1787115151.718276:0:14801:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a85368f, atime: 0x6a85368e, ctime: 0x6a85368f, blocks: 0x1 00010000:00010000:3.0:1787115151.718286:0:14801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be70f8b6/0x194cd781e88c99c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.718303:0:14801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787115151.718307:0:14801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115151.718315:0:14801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be70f8b6/0x194cd781e88c99c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.718331:0:14801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be70f8b6/0x194cd781e88c99c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115151.722080:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115151.735143:0:14799:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787115151.735287:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:2.0:1787115151.735829:0:14800:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787115151.736907:0:14799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1787115151.739939:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602670848 00000100:00100000:0.0:1787115151.739953:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602670848 00000100:00100000:0.0:1787115151.740014:0:14799:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787115151.740022:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602670976 00000100:00100000:0.0:1787115151.740026:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602670976 00000100:00100000:0.0:1787115151.740745:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:0.0:1787115151.740761:0:14799:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787115151.740767:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602671104 00000100:00100000:3.0:1787115151.741385:0:16291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602671232 00000100:00100000:3.0:1787115151.741392:0:16291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602671232 00000100:00100000:3.0:1787115151.741447:0:16291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 1 00000100:00100000:3.0:1787115151.741457:0:16291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+14:2363:x1873925602670336:12345-192.168.202.10@tcp:4:dd.0 00010000:00010000:3.0:1787115151.741493:0:16291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b24e8b9e/0x194cd781e88c99cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.741514:0:16291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115151.741520:0:16291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115151.741527:0:16291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b24e8b9e/0x194cd781e88c99cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.741542:0:16291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b24e8b9e/0x194cd781e88c99cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115151.741991:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602671104 00000100:00100000:2.0:1787115151.742725:0:14800:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1787115151.757634:0:16292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 2 00000100:00100000:1.0:1787115151.757664:0:16292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:278330ce-de2f-4eb0-ab55-65b736a927fb+18:2364:x1873925602670592:12345-192.168.202.10@tcp:4:dd.0 00010000:00010000:1.0:1787115151.757709:0:16292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3173755/0x194cd781e88c99d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115151.757728:0:16292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787115151.757733:0:16292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787115151.757739:0:16292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3173755/0x194cd781e88c99d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115151.757754:0:16292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3173755/0x194cd781e88c99d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787115151.805350:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:2.0:1787115151.805379:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:2.0:1787115151.805400:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:2.0:1787115151.805429:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:2.0:1787115151.805493:0:14801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1787115151.805497:0:14801:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787115151 -> 1787115152 00002000:00010000:2.0:1787115151.805500:0:14801:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787115151 -> 1787115152 00002000:00010000:2.0:1787115151.805502:0:14801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:2.0:1787115151.805519:0:14801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be70f8b6/0x194cd781e88c99c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.805550:0:14801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be70f8b6/0x194cd781e88c99c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.805559:0:14801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be70f8b6/0x194cd781e88c99c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.805566:0:14801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aef418de600 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115151.805571:0:14801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be70f8b6/0x194cd781e88c99c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.805580:0:14801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be70f8b6/0x194cd781e88c99c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.805598:0:14801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be70f8b6/0x194cd781e88c99c4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.805606:0:14801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be70f8b6/0x194cd781e88c99c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115151.805700:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+18:2363:x1873925602670464:12345-192.168.202.10@tcp:4:dd.0 Request processed in 87480us (92781us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1787115151.805710:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 0 00000100:00100000:2.0:1787115151.805741:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 3 00000100:00100000:2.0:1787115151.805752:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+17:2364:x1873925602670720:12345-192.168.202.10@tcp:4:dd.0 00010000:00010000:2.0:1787115151.805784:0:14801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c99d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.805811:0:14801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115151.805816:0:14801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115151.805822:0:14801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c99d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.805834:0:14801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c99d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787115151.850275:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1787115151.858127:0:16291:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:2.0:1787115151.858135:0:16291:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 8199 00010000:00010000:2.0:1787115151.858151:0:16291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b24e8b9e/0x194cd781e88c99cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.858165:0:16291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b24e8b9e/0x194cd781e88c99cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.858175:0:16291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b24e8b9e/0x194cd781e88c99cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.858183:0:16291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aef418de000 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115151.858189:0:16291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b24e8b9e/0x194cd781e88c99cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.858198:0:16291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b24e8b9e/0x194cd781e88c99cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.858237:0:16291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b24e8b9e/0x194cd781e88c99cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.858245:0:16291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b24e8b9e/0x194cd781e88c99cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115151.858337:0:16291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+15:2363:x1873925602670336:12345-192.168.202.10@tcp:4:dd.0 Request processed in 116877us (145363us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787115151.858348:0:16291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 1 00000100:00100000:2.0:1787115151.858380:0:16291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 4 00000100:00100000:2.0:1787115151.858391:0:16291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+14:2364:x1873925602670848:12345-192.168.202.10@tcp:4:dd.0 00010000:00010000:2.0:1787115151.858434:0:16291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5012/0x194cd781e88c99e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.858445:0:16291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115151.858449:0:16291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787115151.858456:0:16291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5012/0x194cd781e88c99e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.858467:0:16291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5012/0x194cd781e88c99e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.863921:0:16292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3173755/0x194cd781e88c99d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.864031:0:16292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3173755/0x194cd781e88c99d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.864041:0:16292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3173755/0x194cd781e88c99d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.864049:0:16292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0800 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:0.0:1787115151.864055:0:16292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3173755/0x194cd781e88c99d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.864064:0:16292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3173755/0x194cd781e88c99d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.864086:0:16292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3173755/0x194cd781e88c99d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.864095:0:16292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3173755/0x194cd781e88c99d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787115151.864261:0:16292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:278330ce-de2f-4eb0-ab55-65b736a927fb+14:2364:x1873925602670592:12345-192.168.202.10@tcp:4:dd.0 Request processed in 106599us (151256us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787115151.864271:0:16292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 2 00000100:00100000:0.0:1787115151.864304:0:16292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 5 00000100:00100000:0.0:1787115151.864316:0:16292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:278330ce-de2f-4eb0-ab55-65b736a927fb+13:2364:x1873925602670976:12345-192.168.202.10@tcp:4:dd.0 00010000:00010000:0.0:1787115151.864351:0:16292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009791078e/0x194cd781e88c99e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.864368:0:16292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787115151.864373:0:16292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787115151.864380:0:16292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009791078e/0x194cd781e88c99e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.864393:0:16292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009791078e/0x194cd781e88c99e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787115151.878875:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787115151.915399:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:1.0:1787115151.920588:0:14801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:1.0:1787115151.920597:0:14801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:1.0:1787115151.920613:0:14801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c99d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115151.920627:0:14801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c99d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115151.920652:0:14801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c99d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115151.920681:0:14801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040030200 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:1.0:1787115151.920688:0:14801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c99d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115151.920696:0:14801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c99d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115151.920716:0:14801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c99d9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115151.920723:0:14801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007af82d54/0x194cd781e88c99d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787115151.922755:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+15:2364:x1873925602670720:12345-192.168.202.10@tcp:4:dd.0 Request processed in 116995us (209593us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787115151.922770:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 3 00000100:00100000:1.0:1787115151.922868:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 6 00000100:00100000:1.0:1787115151.922882:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06f4c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+14:2364:x1873925602671232:12345-192.168.202.10@tcp:4:dd.0 00010000:00010000:1.0:1787115151.922919:0:14801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b47f7d35/0x194cd781e88c99ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115151.922935:0:14801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787115151.922939:0:14801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787115151.922946:0:14801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b47f7d35/0x194cd781e88c99ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787115151.923030:0:14801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b47f7d35/0x194cd781e88c99ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787115151.961191:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:3.0:1787115151.961212:0:16291:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00010000:00010000:3.0:1787115151.961229:0:16291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5012/0x194cd781e88c99e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.961243:0:16291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5012/0x194cd781e88c99e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.961253:0:16291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5012/0x194cd781e88c99e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.961260:0:16291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af040031000 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:3.0:1787115151.961289:0:16291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5012/0x194cd781e88c99e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.961300:0:16291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5012/0x194cd781e88c99e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.961321:0:16291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5012/0x194cd781e88c99e0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.961330:0:16291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5012/0x194cd781e88c99e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.961351:0:16292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009791078e/0x194cd781e88c99e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.961371:0:16292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009791078e/0x194cd781e88c99e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.961378:0:16292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009791078e/0x194cd781e88c99e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.961384:0:16292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af042cb2600 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115151.961387:0:16292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009791078e/0x194cd781e88c99e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.961394:0:16292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009791078e/0x194cd781e88c99e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.961405:0:16292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009791078e/0x194cd781e88c99e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115151.961421:0:16291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+12:2364:x1873925602670848:12345-192.168.202.10@tcp:4:dd.0 Request processed in 103028us (245947us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1787115151.961430:0:16291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 4 00000100:00100000:3.0:1787115151.961460:0:16291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 7 00000100:00100000:3.0:1787115151.961484:0:16291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+11:2364:x1873925602671104:12345-192.168.202.10@tcp:4:dd.0 00010000:00010000:3.0:1787115151.961517:0:16291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042284b58/0x194cd781e88c99f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.961529:0:16291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115151.961533:0:16291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787115151.961538:0:16291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042284b58/0x194cd781e88c99f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115151.961550:0:16291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042284b58/0x194cd781e88c99f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115151.969149:0:16292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009791078e/0x194cd781e88c99e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115151.969310:0:16292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:278330ce-de2f-4eb0-ab55-65b736a927fb+11:2364:x1873925602670976:12345-192.168.202.10@tcp:4:dd.0 Request processed in 104993us (247235us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787115151.969321:0:16292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 5 00002000:00010000:3.0:1787115152.033757:0:14801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1787115152.033779:0:14801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b47f7d35/0x194cd781e88c99ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115152.033793:0:14801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b47f7d35/0x194cd781e88c99ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115152.034073:0:14801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b47f7d35/0x194cd781e88c99ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115152.034082:0:14801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af07b6a0600 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:3.0:1787115152.034087:0:14801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b47f7d35/0x194cd781e88c99ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115152.034096:0:14801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b47f7d35/0x194cd781e88c99ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787115152.034299:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00010000:00010000:3.0:1787115152.034368:0:14801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b47f7d35/0x194cd781e88c99ee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787115152.034378:0:14801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b47f7d35/0x194cd781e88c99ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787115152.034482:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06f4c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+9:2364:x1873925602671232:12345-192.168.202.10@tcp:4:dd.0 Request processed in 111601us (293737us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1787115152.034507:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 6 00002000:00010000:2.0:1787115152.068918:0:16291:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1787115152.068941:0:16291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042284b58/0x194cd781e88c99f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115152.068980:0:16291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042284b58/0x194cd781e88c99f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115152.068989:0:16291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042284b58/0x194cd781e88c99f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115152.068998:0:16291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aef418de200 already unused, calling callback (ffffffffc14e0300) 00010000:00010000:2.0:1787115152.069003:0:16291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042284b58/0x194cd781e88c99f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115152.069013:0:16291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042284b58/0x194cd781e88c99f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115152.069033:0:16291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042284b58/0x194cd781e88c99f5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787115152.069041:0:16291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042284b58/0x194cd781e88c99f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787115152.069190:0:16291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:278330ce-de2f-4eb0-ab55-65b736a927fb+7:2364:x1873925602671104:12345-192.168.202.10@tcp:4:dd.0 Request processed in 107706us (333902us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787115152.069352:0:16291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 7 00000001:00080000:2.0:1787115152.069389:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00000040:00080000:3.0:1787115152.517398:0:14191:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787115152.517410:0:14191:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787115152.517443:0:14191:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787115152.517449:0:14191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1787115152.903878:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787115153.801420:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787115153.801443:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137037ef-42b3-4c5c-b74a-b929b53d47b0:3309:1873925624670976:0@lo:400:kworker.0 00000100:00100000:2.0:1787115153.801522:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115153.801582:0:14151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624670976 00000100:00100000:2.0:1787115153.801588:0:14151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624670976 00000100:00100000:2.0:1787115153.801653:0:14151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787115153.801661:0:14151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af047e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:3309:x1873925624670976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115153.801710:0:14151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af047e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137037ef-42b3-4c5c-b74a-b929b53d47b0+19:3309:x1873925624670976:12345-0@lo:400:kworker.0 Request processed in 50us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115153.801718:0:14151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787115153.801767:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137037ef-42b3-4c5c-b74a-b929b53d47b0:3309:1873925624670976:0@lo:400:kworker.0 00000100:00100000:2.0:1787115153.801912:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624671104:0@lo:400:kworker.0 00000100:00100000:2.0:1787115153.801939:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115153.801968:0:14795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624671104 00000100:00100000:2.0:1787115153.801972:0:14795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624671104 00000100:00100000:2.0:1787115153.802004:0:14795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787115153.802011:0:14795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624671104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115153.802058:0:14795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873925624671104:12345-0@lo:400:kworker.0 Request processed in 47us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115153.802065:0:14795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787115153.802094:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873925624671104:0@lo:400:kworker.0 00000100:00100000:2.0:1787115153.802148:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624671232:0@lo:400:kworker.0 00000100:00100000:2.0:1787115153.802186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115153.802216:0:15476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624671232 00000100:00100000:2.0:1787115153.802219:0:15476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624671232 00000100:00100000:2.0:1787115153.802244:0:15476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787115153.802250:0:15476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624671232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115153.802294:0:15476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624671232:12345-0@lo:400:kworker.0 Request processed in 43us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115153.802300:0:15476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787115153.802326:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1787115153.802331:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8af045055c00, transno 8589934595 00000004:00080000:2.0:1787115153.802342:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1787115153.802356:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624671232:0@lo:400:kworker.0 00000100:00080000:0.0:1787115153.803081:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787115153.803087:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787115153.803556:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787115153.803566:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624671360:0@lo:400:kworker.0 00000100:00100000:2.0:1787115153.803599:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115153.803639:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624671360 00000100:00100000:2.0:1787115153.803644:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624671360 00000100:00100000:2.0:1787115153.803673:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787115153.803680:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624671360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787115153.803717:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873925624671360:12345-0@lo:400:kworker.0 Request processed in 38us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115153.803723:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787115153.803754:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873925624671360:0@lo:400:kworker.0 00000100:00100000:2.0:1787115153.804545:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787115153.804556:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624671488:0@lo:400:kworker.0 00000100:00100000:2.0:1787115153.804581:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115153.804638:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af0739ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624671616:0@lo:400:kworker.0 00000100:00100000:2.0:1787115153.804664:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787115153.804690:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624671488 00000100:00100000:2.0:1787115153.804694:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624671488 00000100:00100000:2.0:1787115153.804728:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624671616 00000100:00100000:2.0:1787115153.804731:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624671616 00000100:00100000:2.0:1787115153.804750:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787115153.804756:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624671488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787115153.804859:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787115153.804868:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af0739ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624671616:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787115153.804938:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787115153.804978:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873925624671488:12345-0@lo:400:kworker.0 Request processed in 222us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787115153.804985:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787115153.808171:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787115153.808198:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624671744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787115153.808276:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115153.808333:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624671744 00000100:00100000:0.0:1787115153.808342:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624671744 00000100:00100000:0.0:1787115153.808411:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787115153.808421:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624671744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787115153.808462:0:14797:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1787115153.808509:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873925624671744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115153.808517:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787115153.808572:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873925624671744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787115153.809050:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af0739ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873925624671616:12345-0@lo:400:kworker.0 Request processed in 4170us (4371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787115153.809060:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787115153.821315:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873925624671616:0@lo:400:kworker.0 00000100:00100000:2.0:1787115153.821336:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af0739efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873925624671488:0@lo:400:kworker.0 00010000:00010000:0.0:1787115153.929292:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787115154.035798:0:16329:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1787115154.949314:0:14147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787115155.334923:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787115155.334960:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af073aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624671872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787115155.335034:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787115155.335099:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925624671872 00000100:00100000:0.0:1787115155.335132:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925624671872 00000100:00100000:0.0:1787115155.335195:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787115155.335203:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af073aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624671872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787115155.335238:0:14797:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787115155.335284:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af073aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873925624671872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115155.335291:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787115155.335310:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787115155.335347:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af073aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873925624671872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787115155.834866:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115155.834910:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115155.834935:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115155.834953:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115155.834969:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115155.834987:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115155.835009:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.10@tcp (source: 12345-192.168.202.10@tcp) 00000100:00100000:1.0:1787115155.835043:0:14795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602671616 00000100:00100000:1.0:1787115155.835052:0:14795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602671616 00000100:00100000:1.0:1787115155.835104:0:14795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602672128 00000100:00100000:1.0:1787115155.835126:0:14795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602672128 00000100:00100000:1.0:1787115155.835141:0:14795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602671744 00000100:00100000:1.0:1787115155.835143:0:14795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602671744 00000100:00100000:1.0:1787115155.835153:0:14795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602672000 00000100:00100000:1.0:1787115155.835155:0:14795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602672000 00000100:00100000:1.0:1787115155.835172:0:14795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00100000:1.0:1787115155.835181:0:14795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+5:2364:x1873925602671616:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787115155.835266:0:14795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+5:2364:x1873925602671616:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 72us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115155.835274:0:14795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 19 00000100:00100000:1.0:1787115155.835299:0:14795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 20 00000100:00100000:1.0:1787115155.835307:0:14795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+5:2364:x1873925602672128:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787115155.835332:0:14795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+5:2364:x1873925602672128:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 27us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115155.835353:0:14795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 20 00000100:00100000:1.0:1787115155.835364:0:14795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 21 00000100:00100000:1.0:1787115155.835370:0:14795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+5:2364:x1873925602671744:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787115155.835404:0:14795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:278330ce-de2f-4eb0-ab55-65b736a927fb+5:2364:x1873925602671744:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 34us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115155.835411:0:14795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 21 00000100:00100000:1.0:1787115155.835421:0:14795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 22 00000100:00100000:1.0:1787115155.835427:0:14795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+5:2364:x1873925602672000:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787115155.835623:0:14795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+5:2364:x1873925602672000:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 195us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115155.835631:0:14795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 22 00000100:00100000:1.0:1787115155.835652:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602671872 00000100:00100000:1.0:1787115155.835655:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602671872 00000100:00100000:1.0:1787115155.835683:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602671488 00000100:00100000:1.0:1787115155.835686:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602671488 00000100:00100000:1.0:1787115155.835706:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 27 00000100:00100000:1.0:1787115155.835712:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+6:2364:x1873925602671872:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787115155.835739:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68ffbdf9-8bcb-4f1f-8bf8-51d545cfa5e1+6:2364:x1873925602671872:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 27us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115155.835744:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 27 00000100:00100000:1.0:1787115155.835754:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 28 00000100:00100000:1.0:1787115155.835759:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af06ef79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+20:2364:x1873925602671488:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:1.0:1787115155.835784:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af06ef79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:278330ce-de2f-4eb0-ab55-65b736a927fb+20:2364:x1873925602671488:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 25us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787115155.835797:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 28 00000100:00100000:0.0:1787115155.835976:0:14152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873925602671360 00000100:00100000:0.0:1787115155.835981:0:14152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873925602671360 00000100:00100000:0.0:1787115155.836008:0:14152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.10@tcp, seq: 122 00000100:00100000:0.0:1787115155.836015:0:14152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af047e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+13:2364:x1873925602671360:12345-192.168.202.10@tcp:400:kworker.0 00000100:00100000:0.0:1787115155.836040:0:14152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af047e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5965936-b623-4bea-9c39-d92821f4f81e+13:2364:x1873925602671360:12345-192.168.202.10@tcp:400:kworker.0 Request processed in 27us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787115155.836046:0:14152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.10@tcp, seq: 122 00000100:00080000:0.0:1787115155.836072:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787115155.836076:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787115155.836079:0:14154:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787115155.973426:0:14146:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29598 lines, 29598 kept, 0 dropped, 0 bad.